AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems. That’s where we come in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. From first prototype to production scale, Arize AX unifies build, test, and run in a single workspace—so teams can ship faster with confidence.
We’re a Series C company backed by top-tier investors, with over $135M in funding and a rapidly growing customer base of 150+ leading enterprises and Fortune 500 companies. Customers like Booking.com, Uber, Siemens, and PepsiCo leverage Arize to deliver AI that works.
Our On-Prem Engineering team owns the deployment of Arize within customer-managed environments. Beyond partnering with customers to define infrastructure requirements, the team designs and builds the systems that enable Arize to run seamlessly across a wide range of cloud and on-premise infrastructures.
Over time, the team has developed deep expertise in packaging and delivering features from our SaaS platform into reliable, production-ready releases for self-hosted customers. It’s a small, highly dynamic group that operates with a high degree of autonomy, ownership, and initiative.
In this role, you’ll focus on building, packaging, and delivering the Arize stack using a mix of technologies including Bazel, Go, Java, and Python. This is a unique opportunity to work on foundational infrastructure and play a key role in shaping how organizations observe, monitor, and evaluate AI systems in their own environments.
What You’ll Do- Design, build, and maintain scalable backend systems that power the deployment of Arize in customer-managed (on-prem and cloud) environments.
- Develop tooling and infrastructure to package, test, and deliver the Arize platform as reliable, production-ready self-hosted releases.
- Work across the stack using Go, Java, Python, and Bazel to build reproducible builds and deployment pipelines.
- Partner with customers to understand infrastructure constraints and translate them into robust deployment architectures.
- Build and optimize services that support high-volume analytics workloads in resource-constrained or isolated environments.
- Improve system reliability, observability, and upgradeability for distributed deployments.
- 5+ years of experience working with high-performance backend systems.
- Enthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologies.
- Previous work building and operating highly complex platforms/systems.
- Knowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc.
- Familiarity with packaging, release engineering, or reproducible build systems (e.g., Bazel) is a strong plus.
- Ability to operate with autonomy and ownership in a small, fast-moving team.
The estimated annual salary for this role is between $150,000 - $175,000, plus a competitive equity package. Actual compensation is determined based upon a variety of job related factors that may include: transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefit package, including: medical, dental, vision, 401(k) plan, unlimited paid time off, generous parental leave plan, and others for mental and wellness support.
While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.
Arize’s mission is to make the world’s AI work—and work for people.
Our founders came together through a shared frustration: while investments in AI are growing rapidly across every industry, organizations face a critical challenge—understanding whether AI is performing and how to improve it at scale.
Learn more about what we're doing here:
https://techcrunch.com/2025/02/20/arize-ai-hopes-it-has-first-mover-advantage-in-ai-observability/
https://arize.com/blog/arize-ai-raises-70m-series-c-to-build-the-gold-standard-for-ai-evaluation-observability/
Diversity & Inclusion @ Arize
Our company's mission is to make AI work and make AI work for the people, we hope to make an impact in bias industry-wide and that's a big motivator for people who work here. We actively hope that individuals contribute to a good culture
- Regularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI
- Culturally conscious events such as LGBTQ trivia during pride month
- We have an active Lady Arizers subgroup
Similar Jobs
What you need to know about the Boston Tech Scene
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
