NVIDIA Logo

NVIDIA

Senior Deep Learning Compiler Engineer - CUDA

Posted 24 Days Ago
Be an Early Applicant
In-Office or Remote
6 Locations
184K-357K
Senior level
In-Office or Remote
6 Locations
184K-357K
Senior level
Develop compiler technology for CUDA programming, collaborate with hardware teams, and optimize ML/DL systems for performance improvements in AI applications.
The summary above was generated by AI

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

We are looking for outstanding ML/DL compiler engineers to join the team and develop groundbreaking technologies in machine learning compilers and AI systems. We are building foundation compiler technology for the next generation of CUDA programming model that accelerates AI application with rapidly evolving GPU architectures. As a member of the team, you will develop technologies that have a big impact on millions of CUDA developers, all AI frameworks, and even application areas that are beyond AI. You will develop new ML/DL compiler abstractions, build runtimes, and ML/DL -compiler driven system solutions to accelerate large language models, agents and other high-impact machine learning workloads. As part of this role, you will be building a close technical relationship with internal NVIDIA software and hardware teams on push the latest developments to NVIDIA's product.

What you'll be doing:

  • Design and implement Pythonic language interface for tile-aware GPU programming

  • Optimizing compiler pipelines for efficient execution

  • Integrate with AI/ML frameworks

  • Develop performance critical primitives for tensor operations and memory operations

  • Collaborate with hardware teams to co-design compiler optimizations for emerging GPU architectures, including Tensor Core utilization and distributed execution

What we need to see:

  • Bachelor's degree in Computer Science, Electrical Engineering, or related field (or equivalent experience); MS or PhD are preferred

  • 6+ years (academic/ industry) experience with ML/DL systems development preferable for compilers

  • Strong Python and C/C++ programming skills

  • Expert experience in developing or using deep learning frameworks (e.g. PyTorch, JAX, Triton, etc.)

  • Strong sense of ownership, fast learner, passion for quality and user experience

Ways To Stand Out From The Crowd:

  • Proficiency in Python and C++ for DSL development and low-level compiler internals

  • Experience with compiler frameworks (Triton, LLVM, MLIR,TVM) and IR design for GPUs

  • Deep understanding of GPU architectures (CUDA cores, Tensor Cores, memory hierarchies) and tile-based execution models

  • Strong experience machine learning systems research and productionization

  • Open source project ownership or contributions

With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology industry's most desirable employers. We have some of the most brilliant and hardworking people in the world working with us and our product lines are growing fast in some of the hottest state of the art fields such as Deep Learning, Artificial Intelligence, Autonomous Vehicles, Virtual Reality, etc. Our diverse team of talented, capable, and professional people are our greatest asset! If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until October 4, 2025.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Top Skills

C++
Cuda
Gpu
Jax
Llvm
Mlir
Python
PyTorch
Triton
Tvm

Similar Jobs

An Hour Ago
Remote
USA
Mid level
Mid level
Computer Vision • Healthtech • Information Technology • Logistics • Machine Learning • Software • Manufacturing
The GTM Sourcer will support the recruiting team by sourcing candidates for marketing and post-sales functions, ensuring quality candidates at the top of the funnel, and developing creative data-driven sourcing strategies while managing multiple priorities.
An Hour Ago
Remote
USA
Senior level
Senior level
Computer Vision • Healthtech • Information Technology • Logistics • Machine Learning • Software • Manufacturing
The Principal Technical Recruiter will focus on recruiting high-caliber Product Management talent. Responsibilities include strategic sourcing, stakeholder management, and process optimization to ensure high-quality candidate assessments and align with business strategies.
3 Hours Ago
Remote or Hybrid
Austin, TX, USA
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead Solution Architect responsible for guiding clients through technical transformations, aligning architectural vision with business goals, and driving digital transformations using AI capabilities.
Top Skills: AICloudSaaS

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account