Magic (magic.dev) Logo

Magic (magic.dev)

HPC Networking Lead

Job Posted 7 Days Ago Reposted 7 Days Ago
Be an Early Applicant
San Francisco, CA
100K-550K
Senior level
San Francisco, CA
100K-550K
Senior level
The HPC Networking Lead will optimize communication in distributed training by implementing algorithms, designing monitoring systems, and enhancing overall network performance.
The summary above was generated by AI

Magic’s mission is to build safe AGI that accelerates humanity’s progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone. Our approach combines frontier-scale pre-training, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal.

About the role:

As the HPC networking lead, you will be the lead technical contributor to an internal NCCL-like library, aiming to optimize performance for communication patterns our workloads require.

What you might work on: 
  • Implement and tune custom collective communication algorithms for specific topologies

  • Design and implement networking monitoring systems for our training clusters

  • Implement and benchmark collective communication primitives to achieve low latency and high throughput

  • Contribute to the development of debugging and profiling tools for network communication performance analysis

  • Integrate new communication techniques into the overall system architecture

What we’re looking for: 
  • Deep understanding of sharding techniques used in distributed training (pipeline/tensor/data parallelism) 

  • Experience contributing to a collective communication library such as NCCL or an MPI implementation

  • Expert understanding of RoCE/IB RDMA networks and have written distributed algorithms using RDMA

  • A track record of contributing to open-source projects related to high-performance networking

Magic strives to be the place where high-potential individuals can do their best work. We value quick learning and grit just as much as skill and experience. 

Our culture:
  • Integrity. Words and actions should be aligned

  • Hands-on. At Magic, everyone is building 

  • Teamwork. We move as one team, not N individuals

  • Focus. Safely deploy AGI. Everything else is noise

  • Quality. Magic should feel like magic

Compensation, benefits and perks (US):
  • Annual salary range: $100K - $550K

  • Equity is a significant part of total compensation, in addition to salary

  • 401(k) plan with 6% salary matching

  • Generous health, dental and vision insurance for you and your dependents

  • Unlimited paid time off

  • Visa sponsorship and relocation stipend to bring you to SF, if possible

  • A small, fast-paced, highly focused team

Top Skills

Distributed Algorithms
Ib Rdma
Mpi
Nccl
Networking Monitoring Systems
Roce

Similar Jobs

18 Days Ago
Hawthorne, CA, USA
95K-130K
Junior
95K-130K
Junior
Aerospace • Other
The engineer will develop manufacturing processes for the Starship gasifier, collaborating with a team to enhance performance and streamline production. Responsibilities include troubleshooting, authoring work instructions, and training teammates for efficient operations.
Top Skills: Additive ManufacturingCnc MachiningElectrical SchematicsFluid SchematicsGd&TTest AutomationTurbomachinery
21 Days Ago
Santa Ana, CA, USA
145K-193K Annually
Senior level
145K-193K Annually
Senior level
Insurance • Real Estate
As Software Engineering Manager, lead a team in designing and delivering back-end services, ensuring quality and security, while driving team development and continuous improvement.
Top Skills: .Net Core.Net FrameworkAnsibleAws Cloud ServicesC#DockerDynamoDBGoKubernetesMs Sql ServerNode.jsPostgresTerraformTypescript
16 Days Ago
Costa Mesa, CA, USA
155K-215K Annually
Senior level
155K-215K Annually
Senior level
Aerospace • Artificial Intelligence • Hardware • Robotics • Security • Software • Defense
As a Senior Development Engineer, you will conduct hardware testing, lead design reviews, and support hardware demonstrations, ensuring high-quality engineering standards.
Top Skills: CadMatlabNxPythonTeamcenter

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account