Fireworks AI Logo

Fireworks AI

AI Product Engineer

Posted 20 Hours Ago
In-Office or Remote
Hiring Remotely in USA
200K-350K Annually
Mid level
In-Office or Remote
Hiring Remotely in USA
200K-350K Annually
Mid level
Build and own developer-facing product features for an LLM inference and fine-tuning platform, spanning frontend (console, playground), backend services, APIs, deployment, billing, and instrumentation. Ship end-to-end features, collaborate with cross-functional teams, and iterate rapidly based on usage data.
The summary above was generated by AI
About Us:

At Fireworks, we’re building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We’ve been independently benchmarked as the leader in LLM inference speed and are driving cutting-edge innovation through projects like our own function calling and multimodal models. Fireworks is a Series C company valued at $4 billion and backed by top investors including Benchmark, Sequoia, Lightspeed, Index, and Evantic. We’re an ambitious, collaborative team of builders, founded by veterans of Meta PyTorch and Google Vertex AI.

About the Role

We're looking for a product-minded engineer to join Fireworks as a Member of Technical Staff on our Product Engineering team. You'll build the product surfaces that developers and enterprises interact with every day — from the inference API and developer console to fine-tuning workflows, model deployment, billing, and new products like Fire Pass.

Fireworks owns the full stack: training, fine-tuning (SFT and RFT at frontier scale), serverless and dedicated inference, multi-LoRA serving, and agentic orchestration — all on infrastructure we built from scratch. Product Engineering sits on top of that stack and turns it into things developers and Enterprises can actually use. You'll work across the surfaces where our platform meets its users: the APIs they call, the console they configure deployments in, the fine-tuning jobs they launch, the billing systems that meter their usage, and the agentic tooling they build with.

This is a high-autonomy IC role. You'll own features end-to-end — from understanding the problem, to designing the solution, to shipping it, to watching how developers actually use it. We're a small team building a platform that processes trillions of tokens daily, so the work you do will be used immediately and at enormous scale.

 Key Responsibilities
  • Design, build, and ship product features across the Fireworks platform — including the developer console, API surfaces, model playground, fine-tuning workflows, deployment management, and billing
  • Own features end-to-end: scope the problem, build the solution, ship it, instrument it, and iterate based on real usage
  • Build and improve the developer experience for Fireworks' core product capabilities — serverless and on-demand inference, supervised and reinforcement fine-tuning, multi-LoRA serving, and agentic orchestration
  • Work across the full stack — frontend (React/TypeScript), backend services (Python, Go), APIs, and data layers — to deliver polished, production-quality product surfaces
  • Build for products that are evolving rapidly: new model types, new serving paths (standard, priority, fast), new consumption models like Fire Pass, and new capabilities like multi-agent harness tooling
  • Partner closely with Infrastructure, Applied Research, Growth, Data and Design to translate platform capabilities into intuitive developer-facing products
  • Instrument and monitor the systems you build, using data to understand how developers use the platform and where friction exists
  • Move fast and make pragmatic trade-offs — the pace of AI infrastructure demands shipping early, learning quickly, and iterating with conviction
 Minimum Qualifications
  • 3 years of experience as a software engineer, with meaningful time spent building user-facing products
  • Strong full stack development skills — comfortable working across frontend (React/TypeScript), backend (Python, Go, or similar), APIs, and databases
  • Experience building and shipping developer-facing products: APIs, dashboards, consoles, CLIs, or developer tools
  • Track record of owning features end-to-end — you're as comfortable scoping a problem as you are deploying the fix
  • Strong product instincts — you think about the developer experience, not just the implementation
  • Demonstrated ability to operate at high velocity with extreme ownership: you ship fast, make pragmatic trade-offs, and don't wait to be told what to build
 Preferred Qualifications
  • Experience building products on top of complex infrastructure — inference platforms, cloud services, data platforms, or ML tooling
  • Experience building for deeply technical users (developers, ML engineers, platform teams) where the product surface is an API as much as a UI
  • Comfort working in a fast-moving, founder-led environment where the product is evolving week to week and the map is being drawn as you go
  • You build with AI tools daily — you use them to accelerate your own work and have strong intuition for what great AI developer experience looks like from the inside

Total compensation for this role also includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive benefits package. Base salary is determined by a range of factors including individual qualifications, experience, skills, interview performance, market data, and work location. The listed salary range is intended as a guideline and may be adjusted.

Base Pay Range (Plus Equity)
$200,000$350,000 USD
Why Fireworks AI?
  • Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.
  • Build What’s Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally.
  • Ownership & Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI—no bureaucracy, just results.
  • Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.

Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.

Similar Jobs

9 Hours Ago
In-Office or Remote
Georgia, USA
2K-3K Annually
Senior level
2K-3K Annually
Senior level
AdTech • eCommerce • Marketing Tech • Retail
Founding AI Engineer responsible for end-to-end R&D and deployment of AI systems (LLMs, diffusion, vision), building rapid prototypes, orchestrating multi-model agentic workflows, integrating diverse APIs, and shipping scalable web applications to support e-commerce and future SaaS products.
Top Skills: ClaudeComfyuiControlnetCrewaiDiffusersFalFastapiGpt CodexIp-AdaptersLangchainNext.JsPythonReplicateReplitRunpod
Yesterday
In-Office or Remote
200K-250K Annually
Senior level
200K-250K Annually
Senior level
Software
Lead API product direction for search and retrieval primitives, partner with strategic accounts to architect integrations, translate customer insights into product specs and roadmaps, run technical deep-dives and documentation, and prototype and ship production code to improve developer experience and platform reliability.
Top Skills: APIsLlmsRetrieval SystemsSearch Infrastructure
11 Days Ago
Remote
United States
130K-208K Annually
Senior level
130K-208K Annually
Senior level
Database • Analytics
Build and ship production agents and reusable skills on a petabyte-scale observability platform. Own end-to-end agent stack (context engineering, tooling, MCP servers, SDKs, integrations), improve agent observability, evaluate models, and optimize for latency, cost, and reliability while collaborating openly with OSS contributors and customers.
Top Skills: ClickhouseColumnar DatabasesDockerEvent Ingestion PipelinesGoKubernetesLlmsMcpNode.jsOpentelemetryPythonRustSQLTypescript

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account