Software Engineer, Infrastructure

We’re at a pivotal moment for AI and energy. Demand for compute is skyrocketing, but power constraints are becoming a critical bottleneck. Emerald AI sits at the intersection of these two worlds, enabling AI data centers to scale without overwhelming the grid.

Our Emerald Conductor software platform makes data centers flexible and responsive, allowing them to adjust power usage dynamically. This unlocks massive AI growth without major new infrastructure, while also strengthening the grid and supporting the expansion of renewable energy.

We’re a team of experts across AI, cloud, software, and energy—on a mission to scale AI sustainably. We’re backed by leading investors and partners including Radical Ventures and NVIDIA.

Learn more about our vision, team, and backers athttps://www.emeraldai.co/.

As an Infrastructure Software Engineer at Emerald AI, you’ll build and operate the core systems that let customers run large-scale ML workloads reliably and flexibly without overwhelming the grid. Your work will directly support our mission to help AI “factories” scale while stabilizing the power system and enabling more renewables.

Day to day, you’ll configure and maintain cutting-edge ML compute clusters; design orchestration components that integrate with customer and partner environments; deploy secure, reliable cloud services; build scalable data pipelines for real-time control of large distributed systems; and strengthen our testing and continuous deployment practices.

You’ll leverage a major cloud provider (e.g., AWS or GCP) and modern IaC/Kubernetes tooling to deliver resilient, scalable platforms.

• Configure and maintain state-of-the-art ML compute clusters for research, product development and testing.

• Develop orchestration components for integration with customer/partner clusters running large-scale ML workloads.

• Deploy secure and reliable cloud infrastructure and services.

• Build scalable data pipelines that support real-time control of large distributed systems.

• Enhance testing and continuous deployment capabilities to promote software quality and reliability.

• BS/MS or PhD in CS/EE or any other relevant field with 3+ years of industry experience in backend software development and cloud/ML infrastructure.

• Proficiency in one or more programming languages: Python, Go, Rust, or C/C++.

• Expert level knowledge of at least one major cloud platform (AWS/GCP/etc.).

• Understanding of distributed systems and AI/ML infrastructure.

• Significant experience with terraform and other Infrastructure as Code tools.

• Experience with Kubernetes in a production environment.

• Experience building CI/CD pipelines with Github Actions, Jenkins, or similar.

• Experience with large-scale distributed AI/ML platform tooling (e.g., DeepSpeed, Horovod, Ray, etc.).

• Exposure to telemetry systems like Prometheus, Grafana.

• Make an impact. Solve the AI power bottleneck and shape how data centers scale sustainably.

• Join a world-class team of AI, cloud, software, and energy experts in a collaborative, low-ego environment.

• Build from 0→1. Influence strategy, GTM, org design, and customer/investor engagement from day one.

• Competitive pay + equity. Stock options let you share in the value you help create.

• Comprehensive benefits, including medical, dental, vision, and 401(k) matching.

• Flexible location. Work from D.C., Boston, or the Bay Area, with 1 WFH day/week.
  Backed by top investors, including Radical Ventures and NVIDIA.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation.

Emerald AI strives to respect the dignity and ‎independence of people with disabilities and is committed to giving them the same ‎‎opportunity to succeed as all other employees.

Inclusiveness is core to our culture at Emerald AI, and we strive to ensure you get the most from your interview experience. Emerald AI makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to the Talent team.