AZX Logo

AZX

Senior Backend Engineer (AI Platform)

Posted One Month Ago
Remote
Hiring Remotely in United States
140K-230K Annually
Mid level
Remote
Hiring Remotely in United States
140K-230K Annually
Mid level
Build and maintain backend infrastructure for AZX’s LLM gateway, including routing, rate limiting, key management, observability, sandboxing, Kubernetes services, operators, and autoscaling. Develop high-performance services in Go, Rust, or async Python using Envoy and gRPC. Support reliable model serving across cloud and customer-managed clusters, collaborate across platform teams, and help develop scalable inference and evaluation capabilities.
The summary above was generated by AI

About AZX

Our mission is to accelerate positive impact in critical industries through AI transformation. We specialize in physics-informed ML and enterprise AI solutions that directly address climate and sustainability challenges.

We’re growing quickly and already work with category-leaders in real estate (CBRE), energy (LevelTen Energy), logistics (Flexe) and utilities.

We’re a public benefit corporation, founded in 2024, and have been profitable from inception.

We work on challenges in clean energy, decarbonization, climate risk, energy systems, and global economics. We’re building our company for long-term success and aim to create the ultimate place to work for those passionate about AI and making a positive impact.

About the Role

As a Backend Engineer you will build the services our products and client solutions run on. The center of gravity is LLM infrastructure: the layer that puts one governed front door over many models, hosted and self-hosted, and answers the questions enterprises actually ask — who used which model, for what, at what cost, under whose rules. The platform's first customers are our own client-facing engineers, the people delivering client outcomes with what you build, so requirements arrive concrete, feedback arrives same-day, and the people you support are in the same meeting.

Responsibilities:

  • Own the LLM gateway: routing, metering, budgets, guardrail composition, and provider/backend adapters across hosted and self-hosted models.

  • Manage the retrieval and knowledge service: connectors, chunking, hybrid search and reranking, grounded answers, and the MCP surface.

  • Build the eval harness that turns retrieval tuning from judgment into evidence, with confidence intervals and per-segment breakdowns.

  • Own the async framework — its public API, rate-limit algorithms, and admin tooling — and lead its evolution into durable execution for agent runs.

  • Design authorization across the whole surface: token hierarchies, capability grammars, and per-tenant isolation tested as a regression, not asserted in a doc.

  • Own your own definition of done on everything you ship: evals, traces, cost accounting, and the dashboard that would wake you up.

Core Qualifications:

  • 5+ years of deep, production async Python — cancellation scopes, streaming lifecycle, and connection pooling

  • Postgres as infrastructure — comfortable reasoning about MVCC, advisory locks, and vacuum discipline, with Redis/Dragonfly used (and not used) where it belongs; real distributed-systems experience, not just familiarity.

  • Experience shipping API surfaces other engineers build on — versioning, idempotency, error vocabularies, migration discipline, and documentation to match.

  • Depth in at least one of LLM gateway concern (routing, metering, guardrails, provider failover) or retrieval engineering (hybrid search, reranking, eval methodology, audit-ready RAG), with credibility on the other.

  • A cost accounting and evals first mindset — you've shipped a gate or harness that caught a real regression, ideally one of your own.

  • Production depth in some modern stack, and the aptitude to ramp quickly on unfamiliar tools

  • Practical familiarity with our core stack — Python 3.12+ (async, type-strict, FastAPI/Starlette, Pydantic v2), asyncpg/SQLAlchemy, Postgres (incl. pgvector), and Redis/Dragonfly with Lua — with willingness to research into the rest.

  • Exposure to the surrounding ecosystem: OpenTelemetry (incl. GenAI conventions), SSE/streaming lifecycles, OpenAI/Anthropic provider APIs, job frameworks (Celery/Dramatiq/Prefect-class), rate-limit algorithms (token bucket, GCRA), and integer-cents money handling.

  • Past work in energy, real estate, utilities, climate or related fields is a plus

  • Experience in both startup and enterprise environments is a plus

Why AZX!

  • Be part of a fast-growing, profitable, mission-driven company with industry-leading clients tackling the massive opportunity of AI transformation in critical industries.

  • Competitive early-stage startup compensation (based on capabilities, experience, and location)

  • Bonus eligibility

  • Health insurance with meaningful coverage for dependents

  • Flexible paid time off

  • Equity

  • Fully remote culture with a cluster of teammates in Seattle

 

Additional Information:

  • Must be willing to travel to Seattle area for final interview and travel 2x/year for company summits

  • Applicants must be currently authorized to work in the United States on a full-time basis.

  • We are unable to sponsor or take over sponsorship of employment visas at this time.

  • Please only apply to a maximum of 2 roles at a time, any applicants who apply to more then 2 roles within a 6 month period will automatically be disqualified

 

Next Steps:

If this job sounds like a great fit but don’t check ALL of these qualification boxes, we’d still love to hear from you!

Similar Jobs

One Month Ago
Easy Apply
Remote
USA
Easy Apply
186K-219K Annually
Senior level
186K-219K Annually
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Design and deliver LLM-powered, agentic AI systems to automate customer support and compliance. Build scalable, secure backend infrastructure in Python and Go, integrate third-party models/APIs, implement grounding and guardrails, and measure performance. Lead end-to-end projects, mentor engineers, conduct code reviews, and participate in on-call and incident response to improve resolution times and reduce operational costs.
Top Skills: Agentic Ai FrameworksDockerGoLlmMongoDBPostgresPrompt EngineeringPythonRetrieval-Augmented Generation (Rag)
38 Minutes Ago
Remote
New Jersey, USA
161K-378K Annually
Expert/Leader
161K-378K Annually
Expert/Leader
Artificial Intelligence • Cloud • Information Technology • Consulting
Leads presales solution architecture for global system integrators and enterprise customers, specializing in observability, AIOps, hybrid and multi-cloud, virtualization, networking, and cloud operations. Develops architectures, demonstrations, proofs of concept, proposals, and technical strategies; supports opportunity progression and cross-selling. Advises executive stakeholders, enables partners, and collaborates with sales, engineering, consulting, delivery, and support teams to position HPE OpsRamp and related cloud operations solutions.
Top Skills: AnsibleAWSDatadogDockerDynatraceElasticGoogle Cloud PlatformGrafanaHpe MorpheusHpe OpsrampHpe Vm EssentialsKubernetesKvmAzureMicrosoft Hyper-VNutanix AhvOpenshiftOpentelemetryPrometheusRest ApisSd-WanSplunkTerraformVmware AriaVmware EsxiVmware Vsphere
38 Minutes Ago
Remote
California, USA
166K-343K Annually
Senior level
166K-343K Annually
Senior level
Artificial Intelligence • Cloud • Information Technology • Consulting
Drives technical enablement and solution design for channel partners across hybrid and multi-cloud environments. Responsibilities include creating proposals, designing virtualization and infrastructure solutions, supporting demonstrations and proofs of concept, identifying sales opportunities, collaborating on scalable architectures, tracking pipelines, and advising partners. The role requires strong consultative selling, presentation, partner management, and hands-on expertise with hypervisors, operating systems, networking, storage, automation, and IT operations platforms.
Top Skills: Aria AutomationAria OperationsBashDynatraceHpe Cloudops SuiteIscsiKvmLinuxMicrosoft Hyper-VMorpheus EnterpriseMorpheus Vm EssentialsNasOpsrampPowershellRoutingSanSoftware-Defined StorageVirtual SwitchingVlansVmware EsxiWindowsZerto

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account