NVIDIA Logo

NVIDIA

Senior Software Engineer, Cloud-Native Stack – CSP Engagements

Reposted 13 Days Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in Austin, TX
184K-357K Annually
Senior level
In-Office or Remote
Hiring Remotely in Austin, TX
184K-357K Annually
Senior level
Develop and debug cloud-native solutions for AI/ML datacenters, focusing on Kubernetes and Slurm enhancements and customer workflows.
The summary above was generated by AI

We are developing advanced multi-rack, multi-tenant AI/ML datacenters with NVIDIA GB200, and upcoming GB300 GPUs. NVIDIA seeks a Senior Software Engineer for our CSP (Cloud Service Provider) Engagements team to focus on the cloud-native stack for datacenter products like GB200. In this role, You will define customer workflows, prototype stack enhancements, and debug the toughest Kubernetes + Slurm issues in multi-rack, multi-tenant AI datacenters. You'll tackle complex scheduling challenges across racks, tenants, and clouds as part of the CSP engagements team.

What you’ll be doing:

  • Perform deep-dive debugging of multi-rack, multi-tenant clusters: scheduler behavior, container runtime issues, device-plugin crashes, RDMA/IB fabric anomalies, etc.

  • Gather customer requirements and prototype feature extensions for Kubernetes operators, Slurm plugins, and custom micro-services that expose new GPU capabilities.

  • Drive joint architecture reviews and “whiteboard” sessions with CSP and internal platform teams; convert findings into RFCs and upstream pull requests.

  • Create reproducible testbeds (Helm/Ansible/Terraform) that mirror customer environments; automate validation and benchmark suites.

  • Deliver technical collateral-design docs, how-to guides, demo scripts-and present at customer on-sites, KubeCon, and SlurmUG.

  • Collaborate with AE, FAE, and Solution Architect teams to deliver integrated customer solutions and technical documentation.

What we need to see:

  • Strong source-level expertise in Kubernetes internals (scheduler, CRI/CNI/CSI, operators) and Slurm (federation, power-save, plugins).

  • Hands-on experience integrating next-gen GPUs (Blackwell/GB200/GB300) or comparable accelerators into containerized clusters.

  • Proven track record debugging large-scale, cloud-native stacks across networking (RDMA/RoCE), storage, and control planes.

  • Customer-facing engineering or solutions-architect background: requirements gathering, PoC ownership, roadmap influence.

  • Familiarity with CI/CD (GitHub Actions, Tekton), observability (Prometheus, OpenTelemetry), and infrastructure-as-code.

  • Excellent communication-able to switch between deep technical detail and high-level business impact.

  • 10+ years of professional software development experience in distributed systems (Go, Rust, C/C++ or Python for tooling).

  • BS or MS (or equivalent experience) in Computer Engineering, Computer Science, or related field.

Ways to stand out from the crowd:

  • Upstream contributions to Kubernetes, Slurm, Volcano, or similar projects.

  • Experience with GPU computing (CUDA), deep learning workloads

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hard-working people in the world working for us. NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative, hardworking and self-motivated, we want to hear from you!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until June 11, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

An Hour Ago
Remote or Hybrid
United States
112K-186K Annually
Senior level
112K-186K Annually
Senior level
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Lead translation of strategic direction into scalable sales and retention initiatives across Performance Management. Drive cross-business projects, provide analytical and project management support for account planning, product adoption, performance visibility, and revenue retention. Partner with enablement, training, finance, and analytics to execute initiatives, manage risks, and improve decision-making. Remote role requiring Eastern Time Zone residency and up to 25% travel.
Top Skills: Ai ToolsExcelPowerPointSalesforce
2 Hours Ago
Remote or Hybrid
United States
97K-145K Annually
Mid level
97K-145K Annually
Mid level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
The role involves reviewing financial reports, assisting with budgeting, managing a team, and supporting technology integration for manufacturing clients.
Top Skills: Quickbooks OnlineSage Intacct
2 Hours Ago
Remote or Hybrid
United States
97K-145K Annually
Mid level
97K-145K Annually
Mid level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
The role involves overseeing financial reporting for physician practice clients, assisting with budgeting, coaching staff, and collaborating with advisory teams to improve processes and clients' service offerings.
Top Skills: Bill.ComIntaactMicrosoft Office SuiteNetSuiteQuickbooks Online

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account