NVIDIA Logo

NVIDIA

Senior AI Infrastructure Engineer - EDA Infrastructure

Reposted 4 Days Ago
In-Office or Remote
2 Locations
184K-357K Annually
Senior level
In-Office or Remote
2 Locations
184K-357K Annually
Senior level
Build and operate AI infrastructure systems, including telemetry pipelines, observability dashboards, incident-management automation, hardware and software catalogs, service ownership data models, and self-service discovery tools. Lead cross-functional infrastructure initiatives and develop AI-assisted operational tooling. The role requires production software and infrastructure expertise, programming experience, and the ability to improve reliability, visibility, incident response, and operational efficiency across NVIDIA GPU cloud environments.
The summary above was generated by AI

AI Infrastructure Engineers at NVIDIA build the systems, tooling, and data infrastructure that enable operation of our GPU cloud services. We are enabling engineering teams to innovate while proactively identifying, tracking, and mitigating risks across the entire technical task.

This role is ideal for engineers who thrive at the intersection of product, infrastructure, and software engineering and who want to build automated, intelligence-driven systems that protect NVIDIA’s most critical AI platforms.

What you’ll be doing:

Telemetry

  • Build and operate scalable telemetry pipelines for metrics, logs, traces, and events across on-premise, CSP, and NCP clusters.

  • Establish common instrumentation, collection, storage, and access patterns so teams can generate and consume telemetry consistently.

  • Deliver dashboards, alerting, and analysis capabilities that improve service visibility, detection, and troubleshooting.

Operational Excellence

  • Standardize and automate incident, maintenance, service on-call, and support on-call workflows across HWInf.

  • Integrate operational data and lifecycle signals to improve ownership, escalation, communication, and post-incident learning.

  • Build reporting and AI-assisted tooling that reduces manual toil and improves operational responsiveness.

Cataloging and Inventory

  • Build and maintain physical hardware and software catalogs as trusted sources of truth for infrastructure inventory, service ownership, dependencies, and documentation.

  • Create consistent data models and integration pipelines that connect clusters, hardware, services, teams, and operational workflows.

  • Provide self-service discovery capabilities so engineers can quickly identify what they operate, who owns it, and how to support it.

What we need to see:

  • BS degree in Computer Science, Computer Engineering, or a related technical field, or equivalent experience.

  • 8+ years of experience in infrastructure platform engineering, or tooling.

  • Proficiency in one or more programming languages such as Python, Go, Typescript, or Java.

  • Strong understanding of software and infrastructure principles, with experience applying them in production environments.

  • Ability to lead cross-functional initiatives that span internal teams and external partners in varying disciplines across engineering, product, finance, and security. 

Ways to stand out from the crowd:

  • Experience building and operating incident-management processes with internally built and/or externally vended SaaS tools

  • Experience working with building, deploying, and maintaining ML models in production systems along with familiarity with AI agent frameworks or orchestration tools

  • Experience building and operating modern observability platforms to deliver scalable metrics, logs, traces, and profiling Experience working with service catalog and configuration management databases (CMDB)

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hard-working people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you. NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. If you're creative and self-motivated, we want to hear from you! NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services.

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
184,000 USD – 287,500 USD for Level 4; and 224,000 USD – 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 3, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

9 Minutes Ago
Remote or Hybrid
US
78K-108K Annually
Mid level
78K-108K Annually
Mid level
Information Technology
Provides reactive, case-based support for Microsoft core infrastructure across multiple customer environments. Troubleshoots Windows Server, Active Directory, domain controllers, Group Policy, DNS, DHCP, SCCM, endpoint management, and related technologies. Manages service cases, documents resolutions, communicates with customers, meets service-level commitments, participates in on-call rotations, supports infrastructure improvements, and collaborates with technical teams. Provides customer guidance, peer mentoring, technical documentation, and escalation support while identifying potential customer needs.
Top Skills: Active DirectoryAzureDhcpDnsDomain ControllersEndpoint ManagementGroup PolicyMicrosoft 365SccmWindows Server
10 Minutes Ago
Remote or Hybrid
US
86K-119K Annually
Mid level
86K-119K Annually
Mid level
Information Technology
Build and support enterprise data ingestion, transformation, modeling, and integration solutions using Microsoft Fabric and Azure data services. Develop batch, API, file, database, and event-driven pipelines; create dimensional and curated data models; write and optimize SQL; resolve data-quality and pipeline issues; and support production workloads. Collaborate in Agile engineering processes using GitHub, Azure DevOps, CI/CD, code reviews, and reusable development standards.
Top Skills: Azure Data FactoryAzure Data LakeAzure DevopsAzure Key VaultAzure Service BusAzure SqlAzure StorageCi/CdDelta LakeGitGitJSONMicrosoft FabricPysparkPythonRest ApisSQLSQL Server
20 Minutes Ago
Remote or Hybrid
United States
80K-109K Annually
Entry level
80K-109K Annually
Entry level
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Participates in a structured rotational IT program supporting digital transformation, enterprise technology, data, process improvement, and project delivery initiatives. Responsibilities include project planning, tracking, reporting, process analysis, documentation, dashboard development, testing, change management, stakeholder communication, data review, automation, prototyping, and translating business needs into technology solutions.
Top Skills: Cloud TechnologiesCybersecurityEnterprise SystemsGitGitJIRAMS OfficeMicrosoft TeamsPower BISharepointSoftware DevelopmentTableauVisio

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account