Top Tech Jobs & Startup Jobs in Boston, MA

Partners with customers and internal teams to design, deploy, and optimize generative AI and LLM inference solutions. Develops proofs of concept, supports NVIDIA technology adoption, analyzes AI workload performance and power efficiency on Kubernetes, and advises developers, researchers, and data scientists. The role requires expertise in deep learning frameworks, GPU orchestration, MLOps, containerization, observability, and LLM inference, with occasional travel to conferences and customers.

Lead NVIDIA’s RL post-training frameworks strategy and engineering ecosystem across distributed training, inference, rollout, evaluation, orchestration, and NVIDIA platforms. Build and manage globally distributed teams, prioritize upstream and internal investments, establish benchmarks and execution metrics, and drive reliable open-source integrations. Partner with research, product, hardware, CUDA, networking, and external communities to scale reinforcement learning workloads across GPUs and heterogeneous systems.

Drive the development and roadmap of HPC and AI/ML products for physics, plasma, high-energy-density simulations, and resilient materials discovery. Define features, requirements, positioning, and go-to-market strategy; collaborate with engineering and NVIDIA software teams; identify customers and partnerships; and represent products at workshops and conferences.

The role involves owning physics models, defining manufacturing specifications, and validating designs to ensure product quality and performance. The architect will utilize first-principles thinking and AI to improve workflows and drive alignment across engineering teams.

Lead and grow an engineering team building GPU‑accelerated deep learning inference frameworks. Drive roadmap, collaborate with compiler/libraries/research teams, optimize LLM and multimodal model performance, and oversee multi‑GPU communications and production deployment of inference software.

Lead hardware-software co-design for LLM inference: drive and document architecture, build executable C++ hardware models, optimize performance with good algorithms and parallelism, diagnose cross-team chip and subsystem issues, and automate workflows to improve efficiency.

Define high-level SoC subsystem and I/O architecture for LPU products, translate product requirements into architecture and IP specifications, build and validate functional/architectural models (C++, SystemC, Python), and drive tradeoffs across performance, power, reliability, and security while coordinating with IP, firmware, software, RTL, verification, and post-silicon teams.

Design and optimize high-performance C++/CUDA libraries for GPU-based data processing. Improve multi-node GPU communication (UcxExchange), optimize Presto GPU query performance, and lead enhancements across Presto, Velox, and cuDF projects for efficient DataFrame and database acceleration.

Analyze and optimize HPC application performance across CPU and multi-node multi-GPU systems by driving compiler and library improvements. Port and tune applications, evaluate compiler/runtime/driver impacts, and collaborate with compiler development and application engineering teams to deliver performance enhancements.

As a Senior Solutions Architect, you will assist customers in building solutions with NVIDIA's AI technology, focusing on Generative AI and Large Language Models while collaborating across teams for performance analysis.