fal Logo

fal

Operations Engineer, HPC Networking

Reposted Yesterday
Remote
Hiring Remotely in USA
Mid level
Remote
Hiring Remotely in USA
Mid level
As an Operations Engineer, you will manage HPC networking, monitor and debug InfiniBand and Ethernet fabrics, and support fabric bring-up while enhancing operational tools and runbooks.
The summary above was generated by AI

fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and do it at scale without compromise. For developers and enterprises, fal is the foundation that makes generative media not just possible, but practical: a unified platform where high-performance inference, orchestration, and observability come together to unlock new categories of AI-native products.

As generative media reshapes industries across a market projected to grow by hundreds of billions over the next decade, fal is becoming the ecosystem that ambitious teams build on.

About the role

We're hiring an Operations Engineer for HPC Networking to keep our InfiniBand and Ethernet fabrics healthy as we scale.

This is a hands-on role. You'll bring up new fabrics alongside DC ops, monitor the ones in production, and chase down the weird stuff: link flaps, congestion, NCCL stalls, firmware bugs that only show up at scale. 

You're a fit if you've:
  • Operated InfiniBand fabrics in production: subnet manager, routing, partitioning, monitoring.
  • Debugged the full stack: cables, transceivers, switch firmware, HCAs, drivers, NCCL.
  • Brought up new fabrics from cable pull through validation.
  • Scripted your way through repetitive operational work (bash, python, go, whatever).
  • Nice to have: Ethernet RoCE, Spectrum-X, or large-scale GPU cluster networking.
Who you are:
  • Detail-oriented. Cable plant hygiene is a personality trait.
  • Calm under fire. A fabric incident during a customer training run doesn't rattle you.
  • You read vendor release notes for fun, or at least out of self-defense.
  • You'd rather find the root cause than reboot the switch.
Responsibilities:
  • Monitor health and performance of InfiniBand and Ethernet fabrics: switches, HCAs, transceivers, links.
  • Investigate and resolve fabric issues: connectivity, congestion, performance regressions.
  • Support fabric bring-up alongside DC ops and customer-facing teams.
  • Run maintenance and upgrades on switches and control plane components.
  • Partner with cluster ops on cross-domain incidents where the line between compute and network is blurry.
  • Improve the tooling and runbooks so the next incident resolves faster than the last.

Similar Jobs

An Hour Ago
Remote or Hybrid
Arlington, MA, USA
65K-98K Annually
Junior
65K-98K Annually
Junior
Fintech • Insurance • Payments • Social Impact • Financial Services
Underwrite residential mortgage loans by reviewing credit, loan-to-value, debt ratios, property valuation and risk factors for compliance with bank and investor guidelines. Analyze exceptions, deficiencies, and special conditions; recommend alternative loan structures; coach field staff and brokers on technical underwriting issues; exercise independent judgment on matters with significant financial impact.
An Hour Ago
Remote or Hybrid
Arlington, MA, USA
53K-79K Annually
Junior
53K-79K Annually
Junior
Fintech • Insurance • Payments • Social Impact • Financial Services
Manage final stages of residential mortgage closings: prepare and review Closing Disclosures, coordinate with settlement agents and attorneys, finalize funding and wiring, update LOS, ensure regulatory compliance (TRID/RESPA), and support post-closing and audit requests.
Top Skills: Encompass Loan Origination SystemLoan Origination SystemMS Office
An Hour Ago
Remote or Hybrid
United States
95K-119K Annually
Mid level
95K-119K Annually
Mid level
HR Tech • Information Technology • Professional Services • Sales • Software
Sell HiBob’s HRIS to mid-market companies (250–1000 employees) across the Northeast. Manage full sales cycle: prospecting, demos, forecasting, pipeline building, CRM data entry, and attending events to close new business and hit revenue targets.
Top Skills: HibobHrisSaaSSalesforce CRM

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account