Mirantis Logo

Mirantis

Senior Software Engineer, AI Infrastructure

Posted 29 Days Ago
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
Design and build Kubernetes-based LLM serving infrastructure, including GPU scheduling, scaling, model lifecycle management, Helm packaging, enterprise and offline deployments, API integrations, and production observability. Develop across a multi-service Go codebase, contribute design documentation and reviews, and help guide engineering direction. The role requires strong Kubernetes, distributed systems, CI/CD, and infrastructure-as-code expertise, with GPU, inference, or adjacent systems experience.
The summary above was generated by AI
Company Description

Mirantis, an IREN company, is the Kubernetes-native AI infrastructure company, enabling organizations to build and operate scalable, secure, and sovereign infrastructure for modern AI, machine learning, and data-intensive applications. By combining open source innovation with deep expertise in Kubernetes orchestration, Mirantis empowers platform engineering teams to deliver composable, production-ready developer platforms across any environment—on-premises, in the cloud, at the edge, or in sovereign data centers. As enterprises navigate the growing complexity of AI-driven workloads, Mirantis delivers the automation, GPU orchestration, and policy-driven control needed to manage infrastructure with confidence and agility. Committed to open standards and freedom from lock-in, Mirantis ensures that customers retain full control of their infrastructure strategy.  https://www.mirantis.com/

Job Description

What you'll do

  • Design and build LLM serving infrastructure on Kubernetes: deployment, GPU scheduling, scaling, and model lifecycle management.

  • Package the platform for enterprise environments: Helm-based installs, upgrades, and restricted/offline networks.

  • Integrate the serving layer with the platform's API gateway, identity, and metering services.

  • Build the observability for operating GPU inference in production (serving metrics, GPU telemetry).

  • Contribute across a multi-service codebase and help set engineering direction through design docs and reviews.

Qualifications

What we're looking for

  • 5+ years of software engineering experience in infrastructure, platform, or distributed systems.

  • Deep hands-on Kubernetes experience: building and operating production workloads and Helm charts, not just consuming managed clusters.

  • Experience with GPU workloads or LLM inference, or strong adjacent systems experience and a track record of learning fast.

  • Strong Go programming skills; solid CI/CD and infrastructure-as-code skills.

  • Fluency with AI-assisted development tools (Claude Code, OpenAI Codex) as part of your daily engineering workflow.

  • Comfortable with high autonomy on a small, remote-first, written-culture team.

Nice to have

  • Inference performance work (quantization, batching, caching) or distributed serving frameworks.

  • Enterprise deployment experience: air-gapped installs, SSO/OIDC, supply-chain security.

  • UI development experience (e.g. React/TypeScript), useful as the product's management surfaces grow.

  • Open-source contributions in the Kubernetes or ML-infrastructure ecosystems.

 

Additional Information

What does Mirantis offer you?

  • Work with an established Silicon Valley leader in the cloud infrastructure industry;
  • Work with exceptionally passionate, talented and engaging colleagues, helping Fortune 500 and Global 2000 customers implement next-generation cloud technologies;
  • Be a part of cutting-edge, open-source innovation;
  • Thrive in the high-energy environment of a young company where openness, collaboration, risk-taking, and continuous growth are valued;
  • Professional development and training;
  • Attend conferences and working groups;
  • Company outings, happy hours, hackathons, and tech talks;
  • Receive a competitive compensation package with a strong benefits plan.

We are a Leader for Container Management in G2 (#2 after AWS)!

Similar Jobs

9 Hours Ago
Remote
United States
127K-254K Annually
Senior level
127K-254K Annually
Senior level
Blockchain • Financial Services • Cryptocurrency • Web3
Design and operate production infrastructure for AI agent systems, including high-performance Rust services for model inference, orchestration, and execution. Build scalable distributed systems, MLOps capabilities, observability, guardrails, and failure recovery for millions of users. Optimize latency, throughput, reliability, and cost while partnering with agent systems and infrastructure teams to harden experimental prototypes for production.
Top Skills: Asynchronous SystemsCloud-Native InfrastructureContainer OrchestrationDistributed SystemsHigh-Performance NetworkingMlopsModel ServingMonitoringObservabilityRust
13 Days Ago
In-Office or Remote
North Carolina, USA
149K-282K Annually
Senior level
149K-282K Annually
Senior level
Cloud • Information Technology • Internet of Things • Professional Services • Software
Architect and operate Cisco’s AI Compute Platform, developing distributed control-plane services, Kubernetes platforms, GPU schedulers, APIs, controllers, and automated remediation systems. The role manages multi-cluster environments, tenant quotas, workload routing, GPU allocation, and reliability for large-scale training and inference workloads. It also leads architecture reviews, establishes engineering standards, mentors engineers, and drives Infrastructure as Code, GitOps, CI/CD, observability, incident response, and operational excellence.
Top Skills: Amd InstinctCgroupsCi/CdCustom Resource Definitions (Crds)EbpfGitopsGoGrafanaInfinibandKubernetesKubernetes ControllersKubernetes OperatorsKueueLinuxNcclNvidia B200Nvidia B300Nvidia H100Nvidia H200NvlinkOpenshiftPrometheusPythonSlurmSplunkTerraformVolcano
8 Days Ago
Remote
United States
Senior level
Senior level
Artificial Intelligence • Software
Build and operate infrastructure for evaluating coding agents and language models. Design end-to-end features spanning data models, APIs, background workers, and UI; run sandboxed trials; score and aggregate results; improve benchmark quality checks; integrate models and agents; and maintain performance, reliability, concurrency, migrations, tests, and code quality.
Top Skills: CeleryDaytonaDjangoDockerHarborInspectKubernetesMcpModalPostgresPythonReactSwe-BenchTerminal-BenchTypescript

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account