Pragmatike Logo

Pragmatike

Staff AI Engineer

Posted Yesterday
Be an Early Applicant
In-Office or Remote
Hiring Remotely in Boston, MA, USA
200K-350K Annually
Senior level
In-Office or Remote
Hiring Remotely in Boston, MA, USA
200K-350K Annually
Senior level
Lead design and deployment of production AI systems: architect model serving, inference, evaluation, and optimization pipelines; improve latency, throughput, quality, and cost; lead cross-team AI initiatives; set engineering standards; mentor engineers; partner on AI strategy and evaluate emerging models and infrastructure.
The summary above was generated by AI

Location: United States — Remote
Compensation: $200,000–$350,000 USD
Start Date: ASAP
Languages: Fluent English required
Type: Full-time

About the Opportunity

Pragmatike is recruiting on behalf of a fast-growing technology company building critical infrastructure that powers high-volume, real-time business operations across multiple systems and platforms.

We are seeking a Staff AI Engineer to lead the design and deployment of production AI systems at scale.

What You'll Do
  • Lead architecture for production AI systems.

  • Design model serving, inference, evaluation, and optimization pipelines.

  • Improve model latency, throughput, quality, and cost.

  • Lead technical AI initiatives across multiple teams.

  • Establish engineering standards for AI development and deployment.

  • Mentor AI engineers.

  • Partner with Product and Engineering leadership on AI strategy.

  • Evaluate emerging models and infrastructure technologies.

What We're Looking For
  • 7+ years of engineering or ML experience.

  • Deep Python and ML engineering expertise.

  • Strong production LLM experience.

  • Strong distributed systems and system design skills.

  • Experience optimizing inference systems.

  • Strong technical leadership and communication.

Nice to Have
  • vLLM, TGI, Triton, CUDA, PyTorch.

  • Kubernetes and GPU infrastructure.

  • RAG and fine-tuning.

  • AI agents.

  • High-scale AI production environments.

Why Join?

Our client is building highly scalable technology that sits at the core of critical business operations, offering engineers the opportunity to work on complex systems, large-scale integrations, and real-world technical challenges.

You'll join a collaborative, fast-moving environment where ownership is encouraged, decisions are made quickly, and engineers have meaningful influence on architecture, product direction, and engineering culture.

This role offers the opportunity to tackle challenging backend problems, work with modern technologies, and grow alongside an ambitious team building for scale.

Full benefit package and competitive compensation.

 

Pragmatike is committed to a fair, transparent, and inclusive recruitment process. We do not discriminate based on age, disability, gender, gender identity or expression, marital or civil partner status, pregnancy or maternity, race, religion or belief, sex, or sexual orientation.

In accordance with GDPR, your personal data will be processed lawfully, fairly, and securely, and used solely for recruitment purposes, including sharing it with our client(s) for employment consideration. You may request access, correction, or deletion of your data at any time. We are committed to maintaining the confidentiality and security of your information throughout the recruitment process.

Similar Jobs

7 Days Ago
Easy Apply
Remote
United States
Easy Apply
153K-259K Annually
Senior level
153K-259K Annually
Senior level
Cloud • Security • Software • Cybersecurity • Automation
Lead technical direction and architecture for DAP Repository Flows, design and ship autonomous and scheduled agents that operate on customer repositories, improve DAP onboarding, collaborate across teams on platform interfaces, mentor engineers, and solve high-scale technical problems to raise engineering quality.
Top Skills: Autonomous AgentsDuo Agent Platform (Dap)GitlabLarge Language Models (Llms)RubyRuby On RailsSlack
7 Days Ago
Remote or Hybrid
USA
195K-290K Annually
Senior level
195K-290K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Lead design, build, and deploy of large-scale data platforms for LLMs, RAG, and agentic AI systems. Hands-on coding, architecting fault-tolerant pipelines, establishing MLOps/DataOps best practices, mentoring engineers, and operationalizing research into production across Exabyte-scale distributed systems.
Top Skills: AirflowAWSBigQueryDaskDevsecopsDockerFlinkGCPGoJvmKafkaKubeflowKubernetesLangchainLlamaindexLlmsMlflowOciPulsarPythonRetrieval-Augmented Generation (Rag)RustSagemakerSnowflakeSparkVertex Ai
15 Days Ago
Remote or Hybrid
217K-289K Annually
Senior level
217K-289K Annually
Senior level
Healthtech • Social Impact • Software
Lead org-wide developer experience and AI-enabled developer workflows. Identify and solve high-leverage bottlenecks across build systems, monorepo tooling, CI/CD, and test reliability. Drive standards, enable monolith-to-modular migration, embed with product teams, mentor engineers, and deliver AI-native developer tooling and adoption at scale.
Top Skills: Ai AgentsBazelCi/CdGithub ActionsLlmsMonorepo ToolingPython

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account