NVIDIA Logo

NVIDIA

Principal System Cloud Architect

Posted 4 Days Ago
Be an Early Applicant
Remote
2 Locations
272K-426K
Expert/Leader
Remote
2 Locations
272K-426K
Expert/Leader
Lead the architectural vision for NVIDIA's GPU IaaS offerings, define scalable designs, collaborate with partners, and make impactful architectural decisions for high-performance cloud infrastructure.
The summary above was generated by AI

We are seeking a Principal System Architect to lead the architectural vision for NVIDIA’s GPU Infrastructure-as-a-Service (IaaS) offerings. This strategic role focuses on defining reference architectures and system blueprints that integrate NVIDIA’s latest innovations — including GB200 Grace Blackwell systems, Spectrum-X, Bluefield, InfiniBand, Storage (Block, File, Object), and AI Enterprise software stacks — into scalable, high-performance cloud infrastructure for on-prem, Neo Clouds, and CSPs.

This role requires deep engagements across hardware, networking, orchestration, and partner ecosystems to define the future of GPU cloud services.

What you’ll be doing:
  • Architect Future-Ready GPU Infrastructure

  • Define scalable, secure, and efficient architectures for GPU-based IaaS using NVIDIA’s full stack: DGX/HGX, GB200, NVLink/NVSwitch, InfiniBand, and Spectrum-X.

  • Lead Reference Architecture Development

  • Work with internal engineering, cloud partners, and OEMs to define and publish validated reference architectures covering bare-metal provisioning, virtualization, storage fabrics, and networking.

  • Drive End-to-End Cloud Infrastructure Strategy

  • Architect solutions for bare-metal-as-a-service, VMaaS, and container orchestration (Kubernetes), integrated with virtual networking (VPCs), Infiniband fabrics, high-performance storage, and AI workloads.

  • Influence Product Strategy Across Domains

  • Partner with silicon, platform, networking, and software teams to ensure alignment of architecture with NVIDIA’s roadmap for GPU, DPU, and AI services.

  • Engage with Ecosystem Partners

  • Represent NVIDIA in joint solution development with CSPs, OEMs, and hyperscale customers to align infrastructure strategies and deployment practices.

  • Evaluate Trade-Offs and Drive Decisions

  • Make high-impact architectural decisions across performance, scalability, multi-tenancy, power efficiency, and manageability

What we need to see:
  • 15+ years in system architecture, with deep experience in cloud-scale infrastructure, HPC, or AI platforms.

  • Proven expertise in GPU platforms, data center networking (InfiniBand, RoCE, Spectrum), virtual networking, storage, and orchestration technologies.

  • Strong understanding of Kubernetes, VM provisioning, bare-metal provisioning, and infrastructure automation.

  • MS or PhD in Computer Engineering, Electrical Engineering, related field, or equivalent experience..

  • Demonstrated ability to define, document, and present architectural designs and influence cross-functional teams.

Ways to stand out from the crowd:
  • Experience with NVIDIA technologies such as DGX, HGX, GB200, NVLink, NVSwitch, BlueField, Magnum IO, and Spectrum-X.

  • Deep knowledge of AI/ML workloads, distributed training architectures, and GPU scheduler integration.

  • Familiarity with CSP environments (AWS, Azure, OCI, GCP) and hybrid/multi-cloud architectures.

  • Participation in open standards and industry bodies (e.g., OCP, CNCF, Kubernetes SIGs).

With competitive salaries and a generous benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers; we have some of the most forward-thinking and hardworking people in the world working for us and, due to unparalleled growth, our outstanding teams are rapidly growing.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 272,000 USD - 425,500 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until October 24, 2025.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Top Skills

Dgx
Gb200
Gpu Infrastructure-As-A-Service
Hgx
Infiniband
Kubernetes
Nvlink
Nvswitch
Spectrum-X

Similar Jobs

An Hour Ago
Remote or Hybrid
Denver, CO, USA
82K-110K Annually
Mid level
82K-110K Annually
Mid level
Productivity • Sales • Software
The Implementation Consultant will lead implementation projects, design workflows, train customers on monday.com, and ensure successful product adoption.
Top Skills: CRMGraphQLMake.ComMonday.ComProject Management SoftwareService Desk Software
An Hour Ago
Remote or Hybrid
Atlanta, GA, USA
Senior level
Senior level
Productivity • Sales • Software
Lead a team of Account Executives in a fast-paced sales environment. Drive sales strategy, coach team members, and partner cross-functionally to improve efficiency and exceed revenue goals.
Top Skills: SaaS
An Hour Ago
Remote or Hybrid
New York, NY, USA
91K-118K Annually
Junior
91K-118K Annually
Junior
Productivity • Sales • Software
As an Implementation Consultant, you will lead projects, design tailored solutions, train customers, and foster relationships to ensure successful adoption of monday.com products.
Top Skills: GraphQLMake.ComMonday.Com

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account