Yotta Labs Logo

Yotta Labs

Research Engineer Intern - AI Systems

Posted 3 Months Ago
In-Office or Remote
Hiring Remotely in United States
Internship
In-Office or Remote
Hiring Remotely in United States
Internship
12-16 week internship implementing and optimizing GPU/accelerator kernels and custom operators, profiling and improving LLM inference and runtime performance, building benchmarks, fixing regressions, and shipping code to production or open-source AI infra projects.
The summary above was generated by AI

Location: Remote (Global)

Type: Internship

Company: Yotta Labs

Apply: [email protected]

🧠 About Yotta Labs

Yotta Labs is building the next generation multi-silicon AI cloud and runtime platform to power the world’s most demanding AI workloads. We enable training and inference across NVIDIA GPUs, AMD GPUs, and AWS Trainium, helping AI companies achieve the best performance and economics across heterogeneous hardware. Our mission is to provide high-performance AI computing and Model API services, enabling AI companies, research labs, and enterprises to train, deploy and integrate cutting-edge models at scale.

🛠️ Role Overview

We are seeking a highly motivated Research Engineer Intern to work on Trainium, GPU kernels, and LLM systems optimization. Over a 12–16 week internship, you will own a well-scoped project at the intersection of AI Systems, Compiler and Runtime Optimization, Distributed Training & Inference, GPU/Accelerator Kernel Development, and Large Language Model Infrastructure — taking it from design to working, profiled code running on real hardware. Your work will ship to production or open source and directly impact the performance of AI applications deployed on our platform. Strong interns receive return offers for full-time roles.

🎯 Responsibilities

  • Implement and optimize compute kernels for Attention, GEMM, MoE, and quantization on NVIDIA, AMD, or AWS Trainium.

  • Build custom operators using CUDA, Triton, ROCm/HIP, or the Neuron SDK with PyTorch/XLA.

  • Profile and improve inference performance in vLLM, SGLang, and our custom runtimes — kernel fusion, scheduling, KV-cache and memory optimizations.

  • Build benchmarks, chase down performance regressions, and turn profiler traces into concrete speedups.

  • Ship code upstream to open-source AI infrastructure projects, with tests and documentation.

 

✅ Qualifications

  • Currently pursuing a BS, MS, or PhD in Computer Science, Computer Engineering, or a related field.

  • Solid programming skills in Python and familiarity with C++.

  • Understanding of GPU/accelerator architecture fundamentals (memory hierarchy, parallelism, occupancy) from coursework, research, or projects.

  • Experience writing CUDA, Triton, ROCm/HIP, or Neuron kernels — class projects and personal projects count.

  • Strong understanding of AI frameworks (e.g., PyTorch, Dynamo, LMCache), model architectures and profiling tools (e.g. Nsight, ROCm Profiler, or Neuron Profiler).

  • Strong problem-solving skills and the ability to work independently in a collaborative, remote environment.

 

🌟 Preferred Experience

  • Contributions to open-source AI infra projects like vLLM, SGLang, PyTorch, or Triton.

  • Familiarity with LLM inference internals — FlashAttention, PagedAttention, continuous batching, speculative decoding, MoE, or quantization.

  • Experience with profiling tools (e.g. Nsight, ROCm Profiler, Neuron Profiler, or PyTorch Profiler) and performance debugging on real workloads.

  • Publications in top-tier conferences like MLSys, OSDI, SOSP, NSDI, SC, HPCA, or ISCA

🌐 Why Join Yotta Labs?

  • Be part of a visionary team aiming to redefine AI infrastructure and influence the future of multi-silicon AI computing.

  • Work on frontier AI infrastructure problems with access to serious hardware — latest-generation NVIDIA GPUs, AMD accelerators, and AWS Trainium at scale.

  • Get direct mentorship from engineers from leading institutions and tech companies.

  • Competitive internship compensation, a flexible remote work environment, and a fast path to a full-time return offer for top performers.

 

📩 How to Apply

Interested candidates should apply directly or send their resume to [email protected]. Please include links to any relevant projects or contributions (GitHub, open-source PRs, course projects) — for internships, these matter more to us than a cover letter.

Similar Jobs

57 Minutes Ago
Easy Apply
Remote or Hybrid
Easy Apply
79K-103K Annually
Mid level
79K-103K Annually
Mid level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Manage end-to-end implementation and adoption of Samsara’s IoT solutions for mid-market customers. Responsibilities include creating launch plans, tracking implementation progress and account health, delivering product training, demonstrating technology, resolving challenges, and coordinating with Sales, Support, Sales Engineering, and Product. The role requires strong customer communication, consultative implementation skills, technical product experience, stakeholder management, and fluency in English and French.
Top Skills: Equipment MonitoringIotSaaSSamsara Connected Operations CloudVehicle Telematics
2 Hours Ago
In-Office or Remote
Mid level
Mid level
Information Technology • Software • Travel
Build and maintain a mature SaaS platform across Rails backend, JSON APIs, MySQL, and Vue.js frontend. Develop travel features, partner integrations, AI-powered functionality, and document generation; optimize performance, write automated tests, upgrade dependencies, address security issues, investigate production incidents, review code, and document work. The role requires autonomous feature ownership, careful work in a large codebase, and collaboration through Git and pull requests.
Top Skills: Amazon CloudfrontAmazon S3Aws EcsAws LambdaCapybaraDockerFactorybotGitGithub ActionsJavaScriptJson ApisMySQLRspecRubyRuby On RailsSentryVueVuetify
Yesterday
Remote
109K-225K Annually
Senior level
109K-225K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Leads complex, cross-functional technology programs and projects from initiation through delivery. Establishes governance, delivery plans, milestones, dependencies, risk frameworks, and stakeholder cadences. Partners with Product and Engineering leadership to translate strategic roadmaps into executable release plans, manages critical-path issues and escalations, and drives release readiness across multiple teams. The role also improves program execution, release governance, transparency, quality, and delivery velocity in a healthcare technology environment.
Top Skills: AgileAha!Hybrid Delivery ModelsJIRASoftware Development Lifecycle (Sdlc)

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account