Voltage Park Logo

Voltage Park

Infrastructure Engineer (Infiniband / NCCL)

Posted 3 Hours Ago
Be an Early Applicant
In-Office or Remote
2 Locations
140K-170K Annually
Senior level
In-Office or Remote
2 Locations
140K-170K Annually
Senior level
Responsibilities include designing and maintaining automation and frameworks for infrastructure management, tuning InfiniBand networking and NCCL configurations, and improving performance across GPU systems.
The summary above was generated by AI

We are seeking an Infrastructure Engineer with a focus on InfiniBand/NCCL to join our Infrastructure Engineering team. Our engineers design and build automation, tooling, and systems that bridge the gap between physical infrastructure and the platforms that power large-scale AI/ML and HPC workloads.

This role combines the breadth of a core infrastructure engineer with a specialty in high-performance networking and GPU communication. You’ll help ensure our InfiniBand fabric and NCCL stack are tuned, reliable, and efficient at scale — supporting some of the world’s largest GPU clusters.

This is a fully remote position, although candidates must be based in the continental United States. Unfortunately, we are unable to provide sponsorship for this role.

Responsibilities
  • Design, build, and maintain automation, APIs, and frameworks to manage physical infrastructure at scale.

  • Develop and extend systems for server lifecycle management.

  • Implement and tune InfiniBand networking and NCCL configurations for multi-GPU communication.

  • Collaborate with Network, Platform, and Infrastructure Operations teams to support new infrastructure rollouts.

  • Diagnose and improve performance across GPU, NVSwitch, PCIe, and InfiniBand layers.
    Write clear design documents and technical documentation to capture best practices.

Qualifications
  • 8+ years of professional experience in infrastructure engineering, HPC, or related domains.

  • Strong experience with Linux in production environments.

  • Proficiency in Python or similar languages for automation.

  • Deep understanding of InfiniBand networking (CX7 HCAs, fabrics, partitioning, GPUDirect).

  • Familiarity with NCCL, CUDA, and GPU topology optimization.

  • Knowledge of containerization and orchestration concepts.

  • Strong written and verbal communication skills.

Ideal Experiences
  • Experience with Dell PowerEdge XE9680 or other GPU-dense servers.

  • Prior work with NVIDIA H100s, NVSwitch, and large-scale NCCL testing.

  • Familiarity with Mellanox OFED, UCX, and Redfish/iDRAC for management.

  • Broader experience across infrastructure areas (storage, virtualization, networking).

Culture
  • Enjoy collaborating with a motivated, execution-focused team.

  • Comfortable operating with autonomy while aligning to company objectives.

  • Value precision, documentation, and knowledge-sharing.

  • Excited to grow as both a domain specialist (InfiniBand/NCCL) and a generalist infrastructure engineer.

Voltage Park is an equal opportunity employer and makes employment decisions on the basis of merit. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other characteristic under federal, state, or local law. If you require an accommodation during the job application process, please notify your recruiter. 

Compensation Range: $140K - $170K


#BI-Remote

Top Skills

Containerization
Cuda
Gpudirect
Infiniband
Linux
Nccl
Orchestration
Python

Similar Jobs at Voltage Park

3 Hours Ago
In-Office or Remote
2 Locations
140K-170K Annually
Senior level
140K-170K Annually
Senior level
Artificial Intelligence • Cloud • Hardware • Machine Learning • Other • Software • Infrastructure as a Service (IaaS)
The Infrastructure Engineer focuses on observability, designing platforms for metrics and alerting, creating dashboards, deploying telemetry, and collaborating across teams to enhance reliability and transparency.
Top Skills: BashBmc/RedfishElkGoGrafanaKafkaKubernetesOtelPrometheusPromtailPythonVictoriametrics
5 Days Ago
Remote
USA
150K-180K Annually
Senior level
150K-180K Annually
Senior level
Artificial Intelligence • Cloud • Hardware • Machine Learning • Other • Software • Infrastructure as a Service (IaaS)
The Storage Engineer will manage and optimize a large-scale VAST storage system, focusing on performance tuning, system maintenance, and collaboration with teams.
Top Skills: AnsibleHpc Storage SystemsLinuxNfsTerraformVast Storage Systems
5 Days Ago
Remote
USA
140K-200K Annually
Senior level
140K-200K Annually
Senior level
Artificial Intelligence • Cloud • Hardware • Machine Learning • Other • Software • Infrastructure as a Service (IaaS)
Responsible for the stability, scalability, and performance of compute, storage, and platform infrastructure supporting AI/ML workloads. Design and deploy platforms, collaborate across teams, and participate in on-call rotations.
Top Skills: AnsibleAWSBashCephDatacenter Networking EquipmentElk StackGoKubernetesLinuxNfsPrometheusPythonTerraformVast Storage Systems

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account