Develop and optimize GPU-accelerated numerical linear algebra libraries for AI and high-performance computing. Design kernel generation, JIT compilation, matrix operations, and operator fusions; lead projects involving multiple engineers and teams; provide technical mentorship; collaborate with product management and customers on requirements and roadmaps; and improve performance and maintainability through architectural enhancements.
NVIDIA Math Libraries team is looking for a senior engineer to join our development efforts in the area of kernel generation for AI and HPC, specifically targeting matrix operations, JITing and fusions. Around the world, leading commercial and academic organizations are revolutionizing AI, scientific and engineering simulations, and data analytics, using data centers powered by GPUs. Applications of these technologies are in healthcare, NLP, VR, deep learning, autonomous vehicles and countless others. Did you know our team develops the GPU accelerated mathematical libraries that makes all of this possible?
What you will be doing:
- Scoping, designing, and implementing high quality and performance numerical dense linear algebra software on GPUs.
- Owning the execution of projects involving multiple engineers and sometimes teams.
- Providing technical leadership and feedback to library engineers working with you on projects and sometimes mentor interns.
- Working closely with product management and other internal and external customers to understand feature and performance requirements and contribute to the technical roadmaps of libraries.
- Finding opportunities to improve library performance and reduce code maintenance overhead through re-architecting.
- To be successful in your responsibilities which are by nature sophisticated, you will need to find and explain complex solutions, exercise leadership, and coordinate with multiple teams to work towards your goals.
What we need to see:
- PhD, Master’s, or Bachelor's degree in Computer Science, Applied Math, or related science or engineering field of study (or equivalent experience).
- 8+ years of experience in designing, developing, testing, maintenance, and performance optimization of HPC software using C++.
- Strong fundamentals in kernel generation and composable library design for linear algebra.
- Leadership skills in driving software development projects.
- Strong collaboration, communication, and documentation habits.
- Kernel generation. JIT focus/experience desired
Ways to stand out from the crowd:
- Experience with parallel programming, ideally using CUDA, MPI, OpenMP, OpenACC, pthreads.
- Good understanding of Machine Learning and Deep Learning technologies as well as knowledge of GPU (preferred) or CPU hardware architecture.
- Experience with low level programming using assembly for performance optimization and operator fusion is a huge plus.
- Experience with agile software development practices using project management tools such as JIRA.
- A scripting language, preferably Python.
With a competitive salary package and benefits, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. Are you a creative and autonomous GenAI Engineer, who loves challenges? Do you have a genuine passion for advancing the state of AI & machine learning across a variety of industries? If so, we want to hear from you.
#LI-Hybrid
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Similar Jobs
Cloud • Security • Software • Cybersecurity • Automation
Build and maintain behavioral threat detections across GitLab corporate, cloud, SaaS, and customer environments. Identify MITRE ATT&CK coverage gaps, develop and troubleshoot SIEM detections, orchestrate AI agents across the detection lifecycle, and improve detection quality through automation. Collaborate with incident response, red teams, threat intelligence, and engineering teams on threat hunting, purple teaming, root-cause analysis, and security observability.
Top Skills:
Agentic AiAWSCloud SecurityDetections As CodeElasticGCPGitlab Ci/CdGitlab DuoKubernetesLlmsMitre Att&CkPaasSIEMSplunkTerraform
Cloud • Security • Software • Cybersecurity • Automation
Build and operate production AI agents, agentic workflows, MCP servers, and CX applications. Develop Python and TypeScript services, AWS infrastructure, integrations, testing, observability, security controls, and CI/CD pipelines. Partner with Customer Success and other CX teams to prototype solutions, translate workflows into technical plans, and deliver reusable platforms. Mentor engineers and non-engineers, document systems, establish governance, and support reliable handoff and shared ownership.
Top Skills:
Aws EcsAws LambdaAws RdsClaude CodeDockerFastapiFlaskGainsightGitGitlab Ci/CdGitlab Duo Agent PlatformGongGraphQLKantataLarge Language Models (Llms)Model Context Protocol (Mcp)OktaPythonReactRestSalesforceSnowflakeTerraformThought IndustriesTypescriptVue
Cloud • Security • Software • Cybersecurity • Automation
Conduct outbound prospecting, qualify target accounts, generate sales-accepted opportunities, and build pipeline across an assigned territory. Research prospects, execute multichannel outreach using phone, email, and social platforms, and track activities in Salesforce. Collaborate with marketing, sales, and customer success teams, attend regional events, document processes, and mentor new BDRs. The role is fully remote and includes extensive onboarding and training.
Top Skills:
AIDevsecopsGitlabLinkedin Sales NavigatorOutreachSalesforce
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
