NVIDIA Logo

NVIDIA

Senior Manager, AI Infrastructure Engineering - DGX Cloud

Posted 24 Days Ago
In-Office or Remote
2 Locations
272K-426K
Senior level
In-Office or Remote
2 Locations
272K-426K
Senior level
Lead operational excellence in AI tooling, manage engineering teams, and enhance incident management processes while integrating AI technologies.
The summary above was generated by AI

We are looking for a seasoned leader to provide strategic direction and guidance to the operational and AI tooling team in a large-scale, mission-critical environment. This is a people-focused role where you will drive operational excellence by maturing our incident response, change management, problem management, and issue management tooling. You will foster a blameless culture of continuous improvement, while empowering your team to leverage and contribute to both foundational infrastructure and pioneering AI/ML tools for smarter debugging, automation, knowledge sharing, and post-incident learning.

AI Infrastructure Engineers at NVIDIA ensure that our internal and external facing GPU cloud services run maximum reliability and uptime as promised to the users and at the same time enabling developers to make changes to the existing system through careful preparation and planning while keeping an eye on capacity, latency and performance.

What you’ll be doing:
  • Lead a team of software and AI engineers responsible for building systems that power incident, change, and problem management across the DGXC Universe.

  • Guide technical strategy and execution across multiple workstreams across multiple teams

  • Partner with infrastructure, product, and security teams to design resilient systems and enforce consistent operational practices across domains.

  • Own the roadmap and delivery of AI/ML-powered operational tools—improving incident classification, root cause analysis, and mitigation automation.

  • Develop and scale engineering teams to meet growing demands; mentor engineers and technical leads while fostering a high-performing, collaborative culture.

  • Represent the team in cross-organizational forums, drive alignment on priorities, and provide clear technical direction during complex or high-severity incidents.

What we need to see:
  • 12+ overall years of proven experience in software engineering or related technical roles, with 5+ years in engineering leadership, including managing multiple teams or technical programs.

  • BS degree in Computer Science or a related technical field, or equivalent experience.

  • Demonstrated success in building and scaling systems that support incident, change, and problem management across complex, high-scale environments.

  • Experience leading teams in the adoption and integration of AI/ML technologies to enhance operational insight, efficiency, and automation.

  • Excellent interpersonal skills, with the ability to synthesize and convey technical and operational issues to executive stakeholders and multi-functional audiences.

  • Strong people leadership skills—you know how to develop engineers, grow new teams, and drive alignment and execution in high-pressure, high-visibility situations.

Ways to Stand Out from the Crowd
  • You’ve led the design and rollout of internal platforms or operational tooling used company-wide, especially in high-scale or hybrid cloud environments. You have hands-on experience integrating LLMs or other AI/ML technologies into engineering workflows—especially for automation, classification, or summarization use cases.

  • You’ve established or matured incident management programs that improved accountability, reduced MTTR, or enhanced learning from operational events. You’ve driven successful cross-functional efforts involving security, infrastructure, and product teams, and can point to measurable improvements in process or system resilience.

  • You bring a product-minded approach to internal tools—focusing not only on functionality, but also usability, adoption, and long-term maintainability. You have experience owning and scaling a service catalog program at the organizational level to improve service ownership, operational readiness, and engineering accountability across large, complex environments.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hard-working people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you. NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. If you're creative and self-motivated, we want to hear from you! NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 272,000 USD - 425,500 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until July 29, 2025.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Top Skills

AI
Gpu
Ml
Software Engineering

Similar Jobs

55 Minutes Ago
Easy Apply
Remote or Hybrid
USA
Easy Apply
145K-190K
Mid level
145K-190K
Mid level
Food • Software
As a Senior Data Analytics Engineer, you'll manage ChowNow's data platform, build tools for data insights, and collaborate with teams to enhance data availability and accuracy.
Top Skills: AWSDbtPythonSigma ComputingSnowflakeSQLTableau
An Hour Ago
Remote or Hybrid
Pennsylvania, USA
55K-129K Annually
Junior
55K-129K Annually
Junior
AdTech • Digital Media • Marketing Tech
The Solutions Engineer collaborates with sales teams to provide technical support, develop solutions for customers, and enhance product implementation for ad-serving platforms.
Top Skills: Ad-Serving PlatformsDigital Tools
An Hour Ago
Remote or Hybrid
Chicago, IL, USA
130K-165K Annually
Senior level
130K-165K Annually
Senior level
eCommerce • Food • Information Technology • Mobile • Cybersecurity • App development • Big Data Analytics
The Manager Tech Lead will oversee the development of marketing automation workflows and personalization strategies, ensuring alignment with business objectives and technical requirements while managing a team.
Top Skills: BrazeHandlebarsHubspotJinjaJSONLiquidMarketoMparticleSegmentSf Marketing CloudTealiumXML

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account