Cerebras Systems Inc. Logo

Cerebras Systems Inc.

Senior Performance Engineer, Inference

Posted 3 Days Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in Office, Machaze, Manica
Senior level
In-Office or Remote
Hiring Remotely in Office, Machaze, Manica
Senior level
Build and maintain reproducible inference benchmarks (tokens/sec, time-to-first-token, latency, TCO), track GPU/kernel optimizations and quantization impacts, maintain competitive pricing models across inference providers, produce actionable competitive analyses for Sales and Product, and represent Cerebras in third-party benchmarking and industry monitoring.
The summary above was generated by AI

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.
This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.
Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

About The Role

We are hiring a Senior Performance Engineer to join our Product team. You are an expert on state-of-the-art inference performance and will serve as our resident expert on how Cerebras stacks up against alternative inference providers on both price and performance. This role sits at the intersection of performance benchmarking from first principles and competitive intelligence. The role has two core pillars:

  1. Performance Benchmarking
    You will build, run, and maintain reproducible benchmarks that measure Cerebras inference performance for real customer workloads. This includes metrics like tokens per second, time to first token, latency under concurrency, and total cost of ownership (TCO). 

  2. Competitive Pricing Intelligence
    You will build and maintain a living model of competitor pricing across the AI inference landscape, including cloud providers, custom silicon vendors, and inference API platforms. You will work directly with our Sales and Product teams to translate this intelligence into pricing recommendations for enterprise contracts, ensuring Cerebras offers a compelling value proposition for every customer.

This role requires deep, hands-on fluency with open-source inference stacks (vLLM, SGLang, TensorRT-LLM), GPU kernel-level optimization toolchains (CUDA, Triton), and an intuitive understanding of how transformer architecture decisions—attention mechanisms, model sizing, quantization, KV-cache strategies—interact with the realities of GPU memory hierarchies and compute budgets. 

Responsibilities
  • Design standardized benchmark suites for inference workloads (code generation, summarization, multi-turn conversation, agentic tool use) that enable fair, reproducible comparisons. 

  • Stay current with GPU optimization communities (CUDA, Triton, TensorRT) and evaluate how new kernel fusions, flash-attention variants, and quantization techniques shift performance ceilings. 

  • Build and continuously update a competitive pricing model covering token-based pricing, throughput-based pricing, and enterprise contract structures across major inference providers. 

  • Monitor industry announcements, pricing changes, and new product launches. Synthesize findings into actionable briefs for the Sales and Product teams. 

  • Partner with Sales to build deal-specific competitive analyses showing total cost of ownership and performance advantages for enterprise prospects. 

  • Collaborate with Product and Engineering to identify where competitors are closing gaps or where Cerebras has underappreciated advantages. 

  • Track third-party benchmarking sources (Artificial Analysis, InferenceX) and ensure Cerebras is well-represented and accurately measured. 

Skills & Qualifications

Required 

  • Deep practical experience with state-of-the-art open-source inference frameworks like vLLM, SGLang, or TensorRT-LLM. 

  • 5+ years of experience in ML systems, ML research engineering, or high-performance computing. 

  • Strong understanding of LLM inference economics: tokens, throughput, latency, batch sizes, precision trade-offs, and how these translate to customer cost. 

  • Strong understanding of transformer model architecture internals such as attention mechanisms (MHA, MQA,GQA, MLA, DSA, MHA) and KV-cache management, and how each affects memory and compute profiles. 

  • Self-directed and resourceful.  

Preferred 

  • Background in ML research (publications or significant open-source contributions) with a systems or efficiency focus. 

  • Contributions to open-source inference or kernel optimization projects. 

  • Excellent communication skills. You will collaborate with executives, write for engineers, and create materials for sales leaders. 

 

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

  1. Build a breakthrough AI platform beyond the constraints of the GPU.

  2. Publish and open source their cutting-edge AI research.

  3. Work on one of the fastest AI supercomputers in the world.

  4. Enjoy job stability with startup vitality.

  5. Our simple, non-corporate work culture that respects individual beliefs.

Find out more about what it's like to work at Cerebras here!

Apply today and become part of the forefront of groundbreaking advancements in AI!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

Similar Jobs

2 Days Ago
Remote or Hybrid
165K-220K Annually
Senior level
165K-220K Annually
Senior level
Artificial Intelligence • HR Tech • Software • Business Intelligence
Own and ship full‑stack production software across Compa’s web app and backend. Lead architecture and technical decisions, integrate ML/AI into data workflows, mentor through code review, and collaborate with Product and Design to build enterprise features and data pipelines.
Top Skills: AWSDjangoGraphQLLinearMetabaseNotionPythonReactSlackTypescriptVllm
4 Days Ago
Remote or Hybrid
Entry level
Entry level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Inbound-focused growth development representative who qualifies leads, builds top-of-funnel pipeline using AI-powered workflows, conducts personalized outreach across email/phone/social/in-product, collaborates with Sales and Marketing, and meets metrics to accelerate pipeline for Account Executives while developing cybersecurity and GTM expertise.
Top Skills: Ai AgentsAutomation PlatformsGongOutreachSalesforce
5 Days Ago
Remote or Hybrid
Senior level
Senior level
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Lead development and adoption of a Consumer Data Platform: gather requirements, create product roadmaps and specs, coordinate cross-functional teams, ensure data privacy/security, define KPIs, and drive product quality and execution.
Top Skills: AgileConsumer Data LakeCrm/EspCustomer Data Platform (Cdp)Google Cloud Platform (Gcp)InfosecItilMarketing OrchestrationMartechPrivacy By DesignSaaSSafe

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account