NVIDIA Logo

NVIDIA

Distinguished Engineer, Production Engineering, Cluster Management

Posted Yesterday
Be an Early Applicant
Remote or Hybrid
Hiring Remotely in OR, USA
320K-489K Annually
Senior level
Remote or Hybrid
Hiring Remotely in OR, USA
320K-489K Annually
Senior level
Leads the technical strategy, architecture, operating standards, and automation for NVIDIA DGX Cloud clusters across on-premises, hyperscaler, and cloud partner environments. The role drives cluster lifecycle management, production readiness, reliability, restoration, release safety, and cross-team coordination. It requires hands-on software and systems engineering, architectural leadership, and influence across platform, hardware, provider, and service teams.
The summary above was generated by AI

NVIDIA is seeking a Distinguished Engineer to serve as a senior technical leader in the Production Engineering organization. The person will be passionate about leading cluster activities within DGX Cloud GPU capacity. Production Engineering at NVIDIA is tasked with ensuring large-scale production systems remain reliable, manageable, and progressively automated across DGX Cloud resources. Our method combines software engineering, systems engineering, and production expertise. This allows us to develop platforms, workflows, and operating models that preserve GPU infrastructure health, scalability, and availability for researchers and customers.

This position focuses on the operational structure for DGX Cloud clusters across on-prem, hyperscalers, and NVIDIA Cloud Partner environments. The scope includes the engineering connections needed to ensure DGX Cloud capacity is fully functional in production: Kubernetes service management, provider and hardware readiness, on-prem infrastructure handling, deployment and operational preparedness, service reliability collaborations, and the processes that integrate these areas into a unified production system. This is a hands-on Distinguished Engineer role for a deeply technical leader who will define architectural direction for cluster operations throughout DGX Cloud. The right person will combine software engineering rigor, systems depth, and production judgment. They will set technical strategy and establish operating standards. They will guide the framework’s evolution for production operations. They will drive progress on cross-organizational capabilities to keep DGX Cloud capacity usable, supportable, and improving at scale. This role requires both the ability to go deep in building and implementation and the ability to lead through influence across multiple teams and high-consequence production outcomes.

What you'll be doing:

  • Define the long-range technical strategy for operating DGX Cloud clusters consistently across local data centers, hyperscalers, and NeoCloud environments

  • Define the architectural direction and fundamental operating standards for cluster lifecycle, runtime delivery, restoration, release readiness, and steady-state operability concerning DGX Cloud capacity

  • Guide the roadmap and execution of critical cross-organizational investments that improve production readiness, operational safety, performance, and cross-team coordination

  • Make and influence high-impact technical decisions that build how platform, hardware, provider, and service teams work together to operate DGX Cloud resources in production

  • Build durable workflows, interfaces, and engineering handshakes across Kubernetes production service, provider and hardware preparation, on-prem and bare-metal

  • Restructure operations, and service-layer reliability domains

  • Build and evolve the automation, APIs, operating workflows, and readiness gates required to move new capacity into stable production and keep existing capacity balanced

  • Implement production operating approaches that lower manual input, establish clear ownership responsibilities, and increase consistency, traceability, and release safety within DGX Cloud environments

  • Partner closely with platform teams, hardware and provider engineering, service owners, and other Production Engineering leaders to identify repeated friction and convert it into durable improvements in software, processes, and operational interfaces

  • Raise the engineering bar for operability, resilience, scalability, and performance across cluster operations through build leadership, architecture review, and technical standards

What we need to see:

  • BS, MS, or PhD in Computer Science, Electrical Engineering, or a related technical field, or equivalent experience

  • 18+ years of experience building and operating large-scale distributed systems, infrastructure platforms, or production environments

  • Confirmed company-level technical leadership at principal, distinguished, or equivalent scope in production engineering, SRE, infrastructure software, or cloud platforms

  • Consistent track record of defining operating models, architectural direction, and engineering standards across multiple technical domains and organizations

  • Consistent record leading large, cross-team technical efforts from concept through production, including aligning collaborators, navigating for clarity and delivering measurable outcomes

  • Deep experience with one or more of these areas: Kubernetes-based production systems, infrastructure automation, or distributed systems operations.

  • Strong software engineering skills in languages such as Python, Go, or similar low-level programming languages

  • Deep understanding of distributed systems, Linux, networking, containers, and production reliability concerns

  • Experience crafting operational workflows, APIs, service interfaces, or automation frameworks that become the standard way teams run production systems

  • Strong architectural judgment and a validated history of simplifying complex operational problems through reusable software, clear technical strategy, and durable engineering direction

Ways to stand out from the crowd:

  • Defined the structural foundation for a large, heterogeneous infrastructure environment spanning multiple platforms or providers

  • Established widely used operating standards, architectures, APIs, or workflows that improved reliability, operability, or performance at company scale

  • Built automation and engineering interfaces that connect platform teams, infrastructure teams, and service owners into a consistent production system

  • Experience improving production readiness, restoration, runtime safety, or release quality for large-scale infrastructure

  • Equally comfortable setting technical strategy, reviewing architecture at scale, writing code, and driving adoption across organizational boundaries

This role is purposely assigned to the cross-domain production operating model for DGX Cloud capacity. It does not involve a shared platform-software function for typical automation services. Success is achieved by making sure the larger DGX Cloud cluster estate functions optimally in a live environment. The position calls for strong technical leadership, consistent workflows, clear limits, and productive cross-team engineering coordination.

#LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 320,000 USD - 488,750 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until September 7, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

6 Minutes Ago
Easy Apply
Remote
USA
Easy Apply
186K-219K Annually
Senior level
186K-219K Annually
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Build and operate low-latency, event-sourced trading infrastructure for Coinbase’s institutional exchange, including matching engines, order management, risk, market data, and funding systems. Own reliability, correctness, incident response, and failover for high-throughput 24/7 production systems. Drive technical designs, collaborate cross-functionally on milestones, and write highly tested performance-critical backend code in Java, C++, or Go.
Top Skills: C++GoJavaJvmLinux
32 Minutes Ago
In-Office or Remote
United States
130K-150K Annually
Expert/Leader
130K-150K Annually
Expert/Leader
Big Data • Information Technology • Software • Analytics • Energy
Leads strategic business development and enterprise software sales for electric utility and AEC customers. Develops account strategies, identifies and closes opportunities, builds executive relationships, manages complex negotiations, forms strategic partnerships, and collaborates with marketing, product, and customer success teams. The role focuses on substation design, utility planning, AI-enabled engineering workflows, digital twins, and infrastructure modernization, with 30–50% travel across North America.
Top Skills: Artificial IntelligenceDigital TwinEnterprise SoftwareGisSalesforce CRM
2 Hours Ago
Remote or Hybrid
United States
160K-260K Annually
Expert/Leader
160K-260K Annually
Expert/Leader
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Define and govern enterprise-scale data architecture across batch, streaming, warehouse, lakehouse, transactional, and AI use cases. Establish standards for data quality, lineage, access, cataloging, governance, observability, and SLAs. Architect AI-enabled workflows, resolve complex architecture issues, influence roadmaps, and mentor engineers through hands-on technical leadership. The role requires 15+ years of software, data engineering, or architecture experience and expertise in large-scale data platforms and modeling.
Top Skills: AIBatch ProcessingBigQueryData CatalogsData WarehousesDbtFeature StoresGCPLakehousesOlapOltpStreaming ArchitecturesVector Stores

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account