Hudson River Trading Logo

Hudson River Trading

GPU Systems Engineer

Posted 4 Days Ago
Be an Early Applicant
Hybrid
New York, NY
200K-300K
Senior level
Hybrid
New York, NY
200K-300K
Senior level
Design and optimize large-scale GPU compute clusters, troubleshoot performance bottlenecks, and automate deployment and monitoring across thousands of nodes.
The summary above was generated by AI

Hudson River Trading (HRT) is looking for GPU Systems Engineers to help scale and evolve our exceptionally sophisticated HPC/AI research environment. 

Joining our Research and Development team, you will collaborate with experts responsible for the compute, storage, operating systems, and automation tools that enable our trading and research to run 24/7 across the globe. We design, grow, and operate infrastructure at a large scale, including triple-digit petabyte-scale storage and massive CPU and GPU clusters in globally distributed data centers. As such, this is a high-impact role with broad scope, from HPC/AI cluster design and performance tuning, to troubleshooting and automation for thousands of nodes.

Responsibilities

  • Design, build, and optimize large-scale distributed GPU compute clusters
  • Identify and resolve GPU workloads’ performance bottlenecks across compute, storage, and networking layers
  • Collaborate with research and development teams to profile, benchmark, and fine-tune GPU-based workloads
  • Automate system deployment, monitoring, and troubleshooting across thousands of nodes
  • Collaborate with research, and engineering teams to support evolving workloads
  • Own critical infrastructure projects — from concept to implementation and support
  • Test and deploy new hardware and software, and partner with vendors to resolve complex issues
Qualifications 
  • 5+ years of experience in large-scale Linux systems engineering in HPC, AI or distributed infrastructure roles.
  • Extensive experience in Linux system installation, performance tuning, and troubleshooting
  • Expertise in troubleshooting distributed GPU workloads
  • Deep knowledge around GPU optimization and performance  
  • Proficiency in Python scripting and automation frameworks 
    • CUDA or C/C++ experience is a plus
  • Experience with NVIDIA technologies beyond CUDA, such as NCCL, GPUDirect RDMA, and NVLink 
  • Familiarity with configuration management tools (e.g. Salt, Ansible, Puppet, Chef)
  • Comfortable diagnosing complex system issues at the hardware, OS, and network levels
  • Strong communication and organizational skills; able to collaborate across diverse technical teams
  • Thrive in fast-paced environments and excited by high-impact work

Annual base salary range of $200,000 to $300,000. Pay may vary depending on job-related skills and experience. A sign-on and discretionary performance bonuses may also be provided as part of the total compensation package, in addition to company-paid medical and/or other benefits.

Culture

Hudson River Trading (HRT) brings a scientific approach to trading financial products. We have built one of the world's most sophisticated computing environments for research and development. Our researchers are at the forefront of innovation in the world of algorithmic trading.
At HRT we welcome a variety of expertise: mathematics and computer science, physics and engineering, media and tech. We’re a community of self-starters who are motivated by the excitement of being at the cutting edge of automation in every part of our organization—from trading, to business operations, to recruiting and beyond. We value openness and transparency, and celebrate great ideas from HRT veterans and new hires alike. At HRT we’re friends and colleagues – whether we are sharing a meal, playing the latest board game, or writing elegant code. We embrace a culture of togetherness that extends far beyond the walls of our office.
Feel like you belong at HRT? Our goal is to find the best people and bring them together to do great work in a place where everyone is valued. HRT is proud of our diverse staff; we have offices all over the globe and benefit from our varied and unique perspectives. HRT is an equal opportunity employer; so whoever you are we’d love to get to know you.

Top Skills

Ansible
Chef
Gpudirect Rdma
Linux
Nccl
Nvidia Technologies
Nvlink
Puppet
Python
Salt

Hudson River Trading Boston, Massachusetts, USA Office

Boston, MA, United States

Similar Jobs at Hudson River Trading

Yesterday
Hybrid
New York, NY, USA
200K-250K
Junior
200K-250K
Junior
Artificial Intelligence • Fintech • Other • Automation
Develop and deploy custom FPGA and ASIC solutions, collaborating with teams and optimizing designs, with a focus on low latency trading systems.
Top Skills: Amd VivadoAsicC++FpgaLinuxPythonSystemverilog
3 Days Ago
Hybrid
New York, NY, USA
200K-250K
Senior level
200K-250K
Senior level
Artificial Intelligence • Fintech • Other • Automation
The Systems Engineer at HRT will manage large distributed compute clusters, optimize performance, automate tasks, and collaborate with stakeholders.
Top Skills: Configuration Management ToolsDebianLinuxPythonShell ScriptingUbuntuUnix
3 Days Ago
Hybrid
Tarrytown, NY, USA
200K-250K
Senior level
200K-250K
Senior level
Artificial Intelligence • Fintech • Other • Automation
Design, build, and maintain HRT's SQL and NoSQL database infrastructure. Ensure performance, scalability, and reliability in a fast-paced trading environment.
Top Skills: Debian LinuxGrafanaMySQLNoSQLPostgresPrometheusPythonRedisSaltSQLTerraformVictoriametrics

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account