Andromeda (andromeda.ai) Logo

Andromeda (andromeda.ai)

Software Engineer - AI Infrastructure

Reposted 8 Days Ago
In-Office or Remote
Hiring Remotely in USA
Senior level
In-Office or Remote
Hiring Remotely in USA
Senior level
As a Software Engineer in AI Infrastructure, you will design and develop core platform components, build APIs and services, enhance performance, and automate tooling while collaborating across teams and improving system reliability.
The summary above was generated by AI
Software Engineer - AI Infrastructure

Location: North America Remote / San Francisco · Full-Time

About Andromeda

Andromeda Cluster, founded by Nat Friedman and Daniel Gross, is on a mission to democratize access to cutting-edge AI infrastructure previously reserved for hyperscalers. What began with a single managed cluster has quickly evolved into a global platform, connecting leading AI labs, data centers, and cloud providers.

Our orchestration layer seamlessly routes training and inference jobs across the world, unlocking flexibility and efficiency in one of the fastest-growing sectors on earth. Our long-term vision is to establish a global marketplace for AI compute—powering AGI with the same fluidity as world financial markets.

We are scaling rapidly and seeking exceptional talent in AI infrastructure, research, and engineering.

The Role

As an Infrastructure Product Engineer, you will play a pivotal role in building the backbone of Andromeda’s platform. You'll transform complex, real-world infrastructure challenges into scalable product capabilities that benefit our customers.

Positioned at the intersection of infrastructure and product engineering, this role is deeply technical and systems-oriented, yet laser-focused on building solutions with broad leverage.

What You'll Do
  • Design and develop core platform components, including infrastructure orchestration, provisioning, and lifecycle management solutions.

  • Build robust APIs, services, and control planes that abstract over diverse infrastructure types (VMs, Kubernetes, bare metal, schedulers).

  • Translate customer usage patterns into product requirements, delivering impactful features and improvements.

  • Create automation and internal tooling to eliminate manual or ad-hoc operational work.

  • Enhance reliability, performance, and observability at the platform level, emphasizing durable improvements over quick fixes.

  • Collaborate with peer teams to define clear ownership boundaries between platform capabilities and customer-specific solutions.

  • Write clean, maintainable, and well-documented code with a focus on long-term sustainability.

  • Participate in technical design discussions and contribute to the architectural evolution of our platform.

What We're Looking For
  • 5+ years of experience in Infrastructure, Platform, or Backend Engineering roles.

  • Strong systems fundamentals: deep understanding of Linux, networking, storage, and distributed systems.

  • Proven expertise with Kubernetes, VMs, or bare-metal environments.

  • Advanced software engineering skills; capable of building production-grade APIs and services (Python, Go, or similar).

  • Extensive experience with infrastructure as code and automation tools (Terraform, Ansible, Helm, etc.).

  • Demonstrated ability to navigate ambiguity and distill complex problems into clear, maintainable abstractions.

  • Product-focused mindset: care about interfaces, defaults, reliability, and sustainable operations.

  • Excellent written and verbal communication skills; effective collaborator across engineering and product functions.

Nice to Have:

  • Hands-on experience with GPU or AI infrastructure.

  • Experience with control-plane or orchestration systems.

  • Background spanning both infrastructure and application/backend engineering.

  • Experience architecting multi-tenant systems.

  • Strong skills in technical writing and design documentation.

  • Early-stage startup experience.

Why You’ll Love It Here

This is a true builder’s opportunity: you’ll have ownership and autonomy to shape our systems, engage directly with customers and providers, and lay the foundations for scalable, reliable AI infrastructure. Join us at Andromeda and help power the future of AI.

Similar Jobs

Senior level
Blockchain • Financial Services • Cryptocurrency • Web3
Design, build, and optimize high-performance AI infrastructure systems to support intelligent agents, ensuring reliability and scalability for millions of users.
Top Skills: Distributed SystemsMl InfrastructureMlopsRust
32 Minutes Ago
In-Office or Remote
170K-220K Annually
Senior level
170K-220K Annually
Senior level
Productivity • Software • App development • Automation
Manage and expand a portfolio of large enterprise B2B SaaS customers across North America. Develop account plans, deepen executive relationships, identify expansion and upsell opportunities, lead cross-functional teams to deliver measurable outcomes, drive renewals and negotiate terms, and exceed growth and retention targets.
Top Skills: Salesforce CRM
41 Minutes Ago
In-Office or Remote
CA, USA
319K-479K Annually
Expert/Leader
319K-479K Annually
Expert/Leader
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Lead design and delivery of production autonomous agents and agentic workflows: architect orchestration, integrate and optimize frontier LLMs, drive model fine-tuning and evaluation, mentor engineers, and translate business goals into safe, reliable, scalable AI-powered product experiences.
Top Skills: Agent OrchestrationAgentic SystemsFine-TuningLlmsModel DistillationModel OptimizationMulti-Agent CoordinationPrompt EngineeringReinforcement Learning From Human Feedback (Rlhf)Retrieval-Augmented Generation (Rag)

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account