NVIDIA Logo

NVIDIA

Senior Site Reliability Engineer, AI Infrastructure

Posted Yesterday
In-Office or Remote
2 Locations
184K-357K
Senior level
In-Office or Remote
2 Locations
184K-357K
Senior level
Develop and maintain AI Infrastructure systems, implementing SRE principles, improving observability, and mentoring peers to enhance system reliability and performance.
The summary above was generated by AI

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you! NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for over 30 years. It’s a unique legacy of innovation that’s fueled by phenomenal technology and outstanding people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAn, you’ll be immersed in a diverse, encouraging environment where everyone is inspired to do their best work. Come join the AI Infrastructure Production engineering team and see how you can make a lasting impact on the world.
 

What You Will Be Doing:

  • Develop and maintain large-scale systems supporting critical use cases for AI Infrastructure, driving reliability, operability, and scalability across global public and private clouds.

  • Implement SRE fundamentals, including incident management, monitoring, and performance optimization, while designing automation tools to reduce manual processes and operational overhead.

  • Build tools and frameworks to improve observability, define actionable reliability metrics, and enable fast issue resolution, driving continuous improvement in system performance.

  • Establish frameworks for operational maturity, lead sustainable incident response protocols, and conduct blameless postmortems to improve team efficiency and system resilience.

  • Work with engineering teams to deliver innovative solutions, mentor peers, uphold high standards for code and infrastructure, and contribute to hiring for a diverse, high-performing team.
     

What We Need to See:

  • Degree in Computer Science or related field, or equivalent experience with 8+ years in Software Development, SRE, or Production Engineering.

  • Proficiency in Python and at least one other language (C/C++, Go, Perl, Ruby).

  • Expertise in systems engineering within Linux or Windows environments and cloud platforms (AWS, OCI, Azure, GCP).

  • Strong understanding of SRE principles, including error budgets, SLOs, SLAs, and Infrastructure as Code tools (e.g., Terraform CDK).

  • Hands-on experience with observability platforms (e.g., ELK, Prometheus, Loki) and CI/CD systems (e.g., GitLab).

  • Strong communication skills with the ability to convey technical concepts effectively to diverse audiences.

  • Commitment to fostering a culture of diversity, curiosity, and continuous improvement.
     

Ways to stand out from the crowd:

  • Experience in AI training, inferencing, and data infrastructure services.

  • Proficiency in deep learning frameworks like PyTorch, TensorFlow, JAX, and Ray.

  • A strong background in hardware health monitoring and system reliability.

  • Hands-on expertise in operating and scaling distributed systems with stringent SLAs, ensuring high availability and performance.

  • Proven experience in incident, change, and problem management processes, fostering continuous improvement in sophisticated environments.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 31, 2025.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Top Skills

AWS
Azure
C
C++
Elk
GCP
Gitlab
Go
Loki
Oci
Perl
Prometheus
Python
Ruby
Terraform Cdk

Similar Jobs

14 Days Ago
Remote
USA
Senior level
Senior level
Artificial Intelligence • Software
The Senior Site Reliability Engineer will design, build, and maintain scalable AI infrastructure, ensuring system reliability, performance, and effective CI/CD pipelines while mentoring team members.
Top Skills: AnsibleAWSAzureCloudFormationDockerElkGCPGrafanaKubernetesPrometheusPythonTerraform
An Hour Ago
Remote or Hybrid
Atlanta, GA, USA
55K-72K Annually
Junior
55K-72K Annually
Junior
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
The Video Producer will create and manage video content for marketing, collaborate with teams, and ensure timely delivery aligned with brand strategy.
Top Skills: Adobe Premiere ProFinal Cut Pro
An Hour Ago
In-Office or Remote
4 Locations
130K-175K Annually
Senior level
130K-175K Annually
Senior level
Software • App development
The Senior Revenue Operations Manager aligns sales, marketing, and customer success, optimizing revenue processes and systems while leading a technology team member to support revenue activities.
Top Skills: CRMCs PlatformsHubspotMarketing AutomationReporting ToolsSalesforce

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account