Andromeda (andromeda.ai) Logo

Andromeda (andromeda.ai)

Software Engineer - AI Infrastructure

Reposted 2 Months Ago
In-Office or Remote
Hiring Remotely in USA
Senior level
In-Office or Remote
Hiring Remotely in USA
Senior level
As a Software Engineer in AI Infrastructure, you will design and develop core platform components, build APIs and services, enhance performance, and automate tooling while collaborating across teams and improving system reliability.
The summary above was generated by AI
Software Engineer - AI Infrastructure

Location: North America Remote / San Francisco · Full-Time

About Andromeda

Andromeda is a market and infrastructure platform to buy, sell, and operate compute.
We believe demand for compute will grow exponentially. So fast that a handful of vertically integrated providers won't be able to scale across operations, capital, supply chains, and politics to serve it. The result is a massive wave of fragmentation, with AI factories of every shape and size coming to market to fill this demand. Our job is to enable all of that fragmented compute to flow through one platform, delivering reliable capacity to model builders, research labs, and inference providers when they need it. We believe every spare electron should be made productive for AI and we're building the platform that makes that possible.


We sit at the center of three forces:

  • Companies that need reliable, high-performance compute fast

  • A fragmented global supply of GPUs across hyperscalers, neoclouds, and independent data centers

  • Capital, risk, and operational complexity that most teams are not equipped to manage

When we succeed, trillions of dollars of compute will flow through Andromeda. Builders get capacity when they need it. Providers get a reliable way to monetize, operate, and finance infrastructure at scale. Capital gets an easy way to deploy, hedge, and underwrite.
In five years, Andromeda won't just participate in the AI infrastructure market. We will shape it.

The Role

As an Infrastructure Product Engineer, you will play a pivotal role in building the backbone of Andromeda’s platform. You'll transform complex, real-world infrastructure challenges into scalable product capabilities that benefit our customers.

Positioned at the intersection of infrastructure and product engineering, this role is deeply technical and systems-oriented, yet laser-focused on building solutions with broad leverage.

What You'll Do
  • Design and develop core platform components, including infrastructure orchestration, provisioning, and lifecycle management solutions.

  • Build robust APIs, services, and control planes that abstract over diverse infrastructure types (VMs, Kubernetes, bare metal, schedulers).

  • Translate customer usage patterns into product requirements, delivering impactful features and improvements.

  • Create automation and internal tooling to eliminate manual or ad-hoc operational work.

  • Enhance reliability, performance, and observability at the platform level, emphasizing durable improvements over quick fixes.

  • Collaborate with peer teams to define clear ownership boundaries between platform capabilities and customer-specific solutions.

  • Write clean, maintainable, and well-documented code with a focus on long-term sustainability.

  • Participate in technical design discussions and contribute to the architectural evolution of our platform.

What We're Looking For
  • 5+ years of experience in Infrastructure, Platform, or Backend Engineering roles.

  • Strong systems fundamentals: deep understanding of Linux, networking, storage, and distributed systems.

  • Proven expertise with Kubernetes, VMs, or bare-metal environments.

  • Advanced software engineering skills; capable of building production-grade APIs and services (Python, Go, or similar).

  • Extensive experience with infrastructure as code and automation tools (Terraform, Ansible, Helm, etc.).

  • Demonstrated ability to navigate ambiguity and distill complex problems into clear, maintainable abstractions.

  • Product-focused mindset: care about interfaces, defaults, reliability, and sustainable operations.

  • Excellent written and verbal communication skills; effective collaborator across engineering and product functions.

Nice to Have:

  • Hands-on experience with GPU or AI infrastructure.

  • Experience with control-plane or orchestration systems.

  • Background spanning both infrastructure and application/backend engineering.

  • Experience architecting multi-tenant systems.

  • Strong skills in technical writing and design documentation.

  • Early-stage startup experience.

Why You’ll Love It Here

This is a true builder’s opportunity: you’ll have ownership and autonomy to shape our systems, engage directly with customers and providers, and lay the foundations for scalable, reliable AI infrastructure. Join us at Andromeda and help power the future of AI.

Similar Jobs

3 Days Ago
In-Office or Remote
United States
Senior level
Senior level
Database
Build and operate production backend services supporting Supabase AI products, including the MCP server. Responsibilities include service architecture, deployments, scaling, authentication and authorization, observability, reliability targets, on-call incident response, rate limiting, capacity management, and API evolution. The role requires strong TypeScript or Go skills, production backend experience, distributed-systems debugging, and collaboration with Platform and SRE teams in a fully remote environment.
Top Skills: Ci/CdDockerGoGrafanaInfrastructure As CodeJwtLogflareMcpNode.jsOauthOidcOpentelemetryPostgresTypescript
Senior level
Blockchain • Financial Services • Cryptocurrency • Web3
Build and operate production AI infrastructure powering intelligent agents at scale. Develop high-performance Rust services for model inference, orchestration, and execution; design scalable distributed systems; establish MLOps, observability, guardrails, and failure recovery; and optimize latency, throughput, reliability, and cost. Partner with agent systems and infrastructure teams to turn prototypes into hardened services serving millions of users.
Top Skills: Async SystemsCloud-Native InfrastructureContainer OrchestrationDistributed SystemsHigh-Performance NetworkingMl InfrastructureMlopsModel ServingMonitoringObservabilityRust
An Hour Ago
Easy Apply
Remote
United States
Easy Apply
168K-286K Annually
Expert/Leader
168K-286K Annually
Expert/Leader
Cloud • Security • Software • Cybersecurity • Automation
Sets product strategy for tenant scalability and unified deployment across GitLab.com, Dedicated, and future deployment models. Defines platform requirements, partners with technical engineering teams, validates customer needs, builds investment cases, manages cross-functional alignment, and guides tradeoffs involving isolation, regionality, compliance, and platform unification. The role also represents GitLab externally as a thought leader and coaches other product managers.
Top Skills: AutoscalingCellular ArchitectureCloud ServicesGitlabHorizontal ScalabilityMultitenancySaaS

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account