Hut 8 Logo

Hut 8

AI Infrastructure Operations Engineer - Compute & Storage - Highrise AI

Posted 6 Days Ago
Remote
Hiring Remotely in USA
Mid level
Remote
Hiring Remotely in USA
Mid level
Provides Tier 2 operational support for large-scale GPU compute and storage platforms. Responsibilities include troubleshooting Linux servers, GPU systems, storage services, Kubernetes and Slurm environments; managing incidents and tickets; provisioning and maintaining nodes; coordinating with NOC, SRE, data center technicians, vendors, and Tier 3 teams; supporting upgrades and cluster expansions; documenting issues; and automating recurring operational tasks with Bash or Python.
The summary above was generated by AI


About Highrise AI 

Highrise AI is a GPU-native infrastructure platform built for modern AI workloads. Designed for developers and enterprises operating in performance-critical and security-sensitive environments, Highrise delivers scalable GPU compute across dedicated clusters, managed cloud, and confidential environments. 

Highrise combines bare-metal performance with full-stack orchestration, API-driven access, and hardware-enforced isolation to support training, fine-tuning, and production-scale deployment of AI models. From reserved GPU capacity to enterprise-grade confidential compute, Highrise provides flexible infrastructure models tailored to the needs of builders operating at scale. 

Beyond infrastructure, Highrise integrates disciplined operations, advanced automation, and on-site engineering expertise to sustain high uptime and predictable performance across deployments. These capabilities extend beyond Highrise-owned fleets: through managed services, Highrise also operates third-party GPU hardware on behalf of customers and partners, applying the same operational standards to infrastructure it does not own. 

Highrise is a subsidiary of Hut 8 Corp., an energy infrastructure platform. Hut 8 integrates power, digital infrastructure, and compute at scale. Highrise serves as the compute and operations layer—designing, deploying, and operating next-generation GPU clusters from commissioning through production. 

ROLE OVERVIEW 

We are seeking a mid-level AI Infrastructure Operations Engineer to provide Tier 2 operational support for large-scale GPU compute and storage platforms. This hands-on role focuses on owning technical tickets, restoring service, investigating recurring issues, and maintaining reliable day-to-day operation of production AI clusters. 

Working closely with the NOC, on-site data hall technicians, SRE teams, and senior infrastructure engineers, the engineer will troubleshoot Linux-based compute nodes, GPU systems, storage services, and their supporting software. Complex or systemic issues will be escalated to Tier 3 engineering with clear diagnostics and supporting evidence. 

KEY RESPONSIBILITIES 

Tier 2 Incident and Ticket Management 

  • Own and manage escalated incidents, service requests, and problem tickets from initial technical triage through resolution, escalation, or documented handoff. 
  • Diagnose compute and storage faults using system logs, monitoring dashboards, management interfaces, and approved diagnostic tools. 
  • Assess severity and customer impact; coordinate with the NOC and site teams to restore service within operational and SLA targets. 
  • Produce clear troubleshooting records, timely ticket updates, shift handovers, and actionable Tier 3 or OEM escalations. 

Compute and GPU Platform Operations 

  • Troubleshoot Linux servers, GPU health alerts, boot failures, firmware/driver issues, hardware faults, and resource availability problems. 
  • Support node provisioning, reimaging, configuration changes, routine maintenance, and return-to-service validation using established automation and runbooks. 
  • Investigate Kubernetes and Slurm node or workload failures, working with platform engineers when application or scheduler-level escalation is required. 
  • Perform first-level analysis of connectivity or GPU communication symptoms and engage network or Tier 3 engineers for deeper fabric and performance investigation. 

Storage Operations and Troubleshooting 

  • Monitor and troubleshoot distributed and high-performance storage systems, including capacity, throughput, availability, and client connectivity. 
  • Investigate filesystem mount failures, storage-node or disk alerts, degraded services, and access or performance complaints. 
  • Execute approved recovery, maintenance, and component replacement workflows with storage vendors and data hall technicians. 
  • Support operational tasks across file, object, and block storage platforms as deployed at Highrise sites. 

Operational Readiness and Continuous Improvement 

  • Assist with upgrades, planned maintenance, cluster expansions, and validation activities following established change controls. 
  • Maintain accurate asset, configuration, and ticket records; improve runbooks, troubleshooting checklists, and knowledge articles. 
  • Identify recurring incidents and automate repeatable operational work with scripts and existing infrastructure management tools. 
  • Collaborate with remote engineering teams, on-site technicians, OEMs, and vendors to resolve issues safely and efficiently. 

ABOUT YOU 

Education and Experience 

  • Bachelor's degree in computer science, engineering, or related discipline, or equivalent hands-on experience. 
  • 3–6 years of experience supporting Linux servers, HPC, cloud, or data center infrastructure in a production environment. 
  • Practical troubleshooting experience with enterprise compute hardware, BMC interfaces (iDRAC/iLO or equivalent), operating systems, and monitoring tools. 
  • Working familiarity with storage technologies such as NFS, distributed filesystems, object storage, and storage performance fundamentals. 
  • Experience using ticketing systems, change management procedures, and Bash or Python scripting for routine diagnostics and automation. 
  • Exposure to NVIDIA GPU systems, InfiniBand/RDMA, Kubernetes, Slurm, or AI/HPC storage platforms is a strong advantage. 

Core Competencies 

  • Structured, evidence-driven troubleshooting with sound judgment on when to remediate, collaborate, or escalate. 
  • Strong ownership of tickets, attention to operational detail, and commitment to reliable customer service. 
  • Ability to work effectively across NOC, SRE, hardware, network, storage, and Tier 3 engineering teams. 
  • Clear written and verbal communication in English. 

ABOUT THE WORK ENVIRONMENT 

This is a full-time, engineering role supporting large-scale AI compute infrastructure across multiple sites. Travel to data centers for cluster commissioning, acceptance, and complex troubleshooting will be required. Flexibility to assist with critical incidents or maintenance activities outside regular business hours is expected. This role is hybrid or remote depending on location. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. 

WHAT MAKES HIGHRISE A GREAT PLACE TO WORK 

At Highrise, you will directly influence the performance, reliability, and production readiness of large-scale AI clusters, work alongside experienced infrastructure engineers, and help define the technical standards for a growing global AI infrastructure platform. 

At Highrise, you will have the opportunity to: 

  • Work with bright, driven peers from a range of educational and professional backgrounds including software development, energy, engineering, entrepreneurship, investment banking, private equity, and management consulting 
  • Design and pitch new products, services, and other initiatives to a leadership team consisting of serial entrepreneurs and seasoned executives and backed by a board of directors consisting of industry veterans of energy, finance, and government 
  • Debate ideas and alternatives in a truly meritocratic setting where the learning curve is steep and the lessons come from both senior and junior members of the team 
  • Build a lifelong network of friends and professional connections at the cutting-edge intersection of technology, energy, and infrastructure 

 

Similar Jobs

56 Seconds Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
99K-186K Annually
Senior level
99K-186K Annually
Senior level
Fintech • Mobile • Software • Financial Services
Conducts independent AML and fraud investigations involving retail banking, brokerage, cryptocurrency, and virtual assets. Performs on-chain transaction tracing, evaluates sanctions and money-laundering risks, determines whether activity warrants Suspicious Activity Report filing, and documents case findings. Supports detection improvements, process enhancements, training, and ad hoc investigations while maintaining knowledge of BSA/AML, USA PATRIOT Act, OFAC, and virtual-asset regulations.
Top Skills: Aml Transaction Monitoring SystemsBlockchain Analytics ToolsCase Management SystemsChainalysisCryptocurrency And Virtual AssetsOfac Screening Tools
A Minute Ago
In-Office or Remote
109K-251K Annually
Senior level
109K-251K Annually
Senior level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Promotes Pfizer’s oncology products to healthcare providers, institutions, and influential customers across the assigned territory. Builds relationships with oncology specialists and key opinion leaders, develops strategic account plans, generates product demand, addresses customer needs, and communicates scientific and disease-management information. The role requires pharmaceutical or oncology healthcare experience, strong account-selling abilities, business acumen, domestic travel, and compliance with U.S. work authorization requirements.
A Minute Ago
Remote
2 Locations
76K-200K Annually
Junior
76K-200K Annually
Junior
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Drives sales and develops customer relationships across an assigned neuroscience territory. Builds and executes territory call plans, engages healthcare providers in person and virtually, uses analytics to identify opportunities, and compliantly communicates approved product and disease-state information. Collaborates with internal teams, manages customer inquiries, uses digital engagement tools, and completes administrative responsibilities. The role covers Wausau, Rhinelander, Iron Mountain, and Marquette.

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account