Build and operate automation, tooling, and services for large-scale GPU clusters across cloud and on-premises environments. Develop provisioning, validation, upgrades, monitoring, repair, GitOps, and lifecycle workflows. Improve Day 0–Day 2 operations, reduce manual intervention, troubleshoot distributed systems, and participate in on-call and incident response while partnering across infrastructure teams.
NVIDIA DGX Cloud is building and operating large-scale GPU infrastructure for AI research and production workloads. We are looking for Senior Software Engineers to help build the automation, tooling, and operational systems that make GPU clusters reliable, scalable, and safe to run. This role is part of a production engineering team focused on Kubernetes-based infrastructure, GPU cluster operations, reliability, automation, GitOps, and Day 2 operability across DGX Cloud environments.
What you’ll be doing:
- Build and operate automation for large-scale GPU clusters across NVIDIA Cloud Partners (NCP) and on-prem environments.
- Develop tools and services for provisioning, validation, upgrades, monitoring, repair, and cluster lifecycle operations.
- Improve Day 0 / Day 1 / Day 2 workflows for cluster bringup, handoff, and production operations.
- Reduce manual production touches through APIs, GitOps, automation, and agent-assisted workflows.
- Participate in on-call, incident response, debugging, and durable follow-up work.
- Partner with platform, storage, networking, security, and workload teams to make infrastructure production-ready.
What we need to see:
- 8+ years of experience building or operating production infrastructure.
- Strong programming skills in Python, Go, or similar.
- Experience with Linux, Kubernetes, containers, cloud infrastructure, or infrastructure automation.
- Ability to troubleshoot distributed systems in production.
- Clear communication and ability to work across teams.
- BS/MS in Computer Science or equivalent experience.
Ways to stand out from the crowd:
- Experience with GPU infrastructure, Kubernetes operators, GitOps, Terraform, ArgoCD, or fleet automation.
- Experience with SLOs, on-call, incident response, observability, and reliability practices.
- Exposure to BMaaS, VMaaS, managed Kubernetes, or multi-cloud infrastructure.
NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. We have some of the most forward-thinking and hard-working people on the planet working for us. If you're creative, hard-working and self-motivated, we want to hear from you!
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Similar Jobs
Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Own the vision, roadmap, and priorities for Snap’s Salesforce CRM platform and connected tools. Translate stakeholder workflows into product requirements, lead UAT and launches, establish AI-driven CRM workflows with privacy safeguards, and measure adoption, productivity, and data quality. The role requires cross-functional leadership, Salesforce expertise, lifecycle ownership, and collaboration with engineering and senior business stakeholders.
Top Skills:
AILlmSalesforce
Cloud • Fintech • Food • Information Technology • Software • Hospitality
Lead the technical vision and execution for Toast IQ, an AI platform using LLMs and agentic workflows. Manage and mentor engineering teams, establish AI architecture and toolchain standards, maintain internal developer platforms, translate strategy into roadmaps, and deliver scalable backend, web, and mobile experiences. Partner with Product and Design to create customer-focused AI capabilities while balancing experimentation, quality, and platform stability.
Top Skills:
Agentic WorkflowsAPIsBuild SystemsCi/CdComponent LibrariesEvalsHarnessesInternal Developer PlatformsLlmsMicrofrontend PatternsMicroservicesMobile ArchitectureSkillsSystem PromptsToolsWeb Architecture
Artificial Intelligence • Marketing Tech • Software • Generative AI • Automation
Lead the IQ Platform engineering team and define the architecture and roadmap for Jasper’s AI context layer. Build scalable knowledge management systems, integrations, and RAG pipelines that improve agent intelligence and reliability. Serve as a player-coach by contributing code, mentoring engineers, partnering with Staff-level technical leaders, and driving major platform initiatives from strategy through delivery.
Top Skills:
AIAi AgentsCloud PlatformsEmbedding StrategiesKnowledge Management SystemsLangchainLlmsRagRetrieval PipelinesSystems Architecture
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
