Arize AI Logo

Arize AI

UX Engineer, LLM Experimentation Platform

Posted 2 Days Ago
Easy Apply
Remote
Hiring Remotely in USA
175K-200K Annually
Mid level
Easy Apply
Remote
Hiring Remotely in USA
175K-200K Annually
Mid level
You will refine existing UX features, prototype interactions, identify user friction points, run usability tests, and collaborate closely with engineers.
The summary above was generated by AI
About Arize

AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems. That’s where we come in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. From first prototype to production scale, Arize AX unifies build, test, and run in a single workspace—so teams can ship faster with confidence.

We’re a Series C company backed by top-tier investors, with over $135M in funding and a rapidly growing customer base of 150+ leading enterprises and Fortune 500 companies. Customers like Booking.com, Uber, Siemens, and PepsiCo leverage Arize to deliver AI that works.

The Opportunity

Most engineering teams treat UX refinement as an afterthought squeezed between feature work. We're carving out a dedicated role for it because we believe the difference between "works" and "delightful" is what separates good products from great ones. You'll have the space to really care about craft.

We're a technical team building for technical users (ML engineers, researchers) who are drowning in complexity. Your job is to make that complexity manageable and maybe even enjoyable. We're looking for an engineer who obsesses over the details that make complex tools feel effortless. You'll work on our LLM evaluation and prompt experimentation platform, taking functional features and refining them into intuitive, polished experiences.

What You’ll Do
  • Refine and iterate on UX for existing features - you won't build from scratch, but you'll make things significantly better
  • Watch real users struggle in Fullstory, identify friction points, and fix them
  • Prototype interaction alternatives rapidly (in Figma or code) to test different approaches
  • Work closely with our Senior engineers who own feature architecture - they build the foundation, you perfect the interface
  • Own the "feel" of the product: transitions, feedback, error handling, progressive disclosure
  • Build reusable interaction patterns that the team can leverage
  • Run lightweight usability tests to validate improvements

A typical week might include:

  • Watching 10 user sessions, identifying 3 common friction points
  • Prototyping 2 different flows for evaluator configuration in Figma
  • Implementing the winner with smooth transitions and helpful inline guidance
  • Pairing with Staff engineers to refactor a complex form into a multi-step wizard
  • Running a quick usability test with 5 users on the new onboarding flow
You're a great fit if:
  • You've made products noticeably better through interaction refinement (show us!)
  • You're comfortable with modern frontend frameworks and animation libraries
  • You've used session replay tools and incorporated user feedback into designs
  • You can work in Figma to prototype before committing to code
  • You think about edge cases, loading states, and empty states automatically
  • You've worked on complex tools (dev tools, data tools, B2B SaaS) where UX really matters
  • Bonus: You've built or contributed to design systems
What you DON'T need:
  • Formal design training (though it's welcome)
  • Full-stack experience (we have engineers for that)
  • Experience with our specific tech stack (we care more about your UX sensibility)

The estimated annual salary for this role is between $175,000 - $200,000, plus a competitive equity package. Actual compensation is determined based on a variety of job-related factors that may include transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellness.

While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.

More About Arize

Arize’s mission is to make the world’s AI work—and work for people.
Our founders came together through a shared frustration: while investments in AI are growing rapidly across every industry, organizations face a critical challenge—understanding whether AI is performing and how to improve it at scale.

Learn more about what we're doing here:

https://techcrunch.com/2025/02/20/arize-ai-hopes-it-has-first-mover-advantage-in-ai-observability/

https://arize.com/blog/arize-ai-raises-70m-series-c-to-build-the-gold-standard-for-ai-evaluation-observability/

Diversity & Inclusion @ Arize

Our company's mission is to make AI work and make AI work for the people, we hope to make an impact in bias industry-wide and that's a big motivator for people who work here. We actively hope that individuals contribute to a good culture

  • Regularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI
  • Culturally conscious events such as LGBTQ trivia during pride month
  • We have an active Lady Arizers subgroup

Top Skills

Animation Libraries
Figma
Modern Frontend Frameworks

Similar Jobs

A Minute Ago
Easy Apply
Remote or Hybrid
USA
Easy Apply
70K-80K Annually
Mid level
70K-80K Annually
Mid level
Fintech • Software • Financial Services
As an API Support Specialist, you'll provide technical support for API integrations, troubleshoot issues, collaborate across departments, and maintain communication with API vendors and users.
Top Skills: .NetAPIsBigQueryC++GCPJavaJIRAJSONRestSQLWebsockets
9 Minutes Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
Expert/Leader
Expert/Leader
Fintech • Mobile • Software • Financial Services
The Independent Risk Management Director will oversee risk management for Big Business Banking products, ensuring risks are monitored and mitigated while collaborating with regulatory authorities and business units.
Top Skills: Google SuiteGrc SystemsMS Office
9 Minutes Ago
Remote or Hybrid
USA
117K-145K Annually
Senior level
117K-145K Annually
Senior level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Software
As a Software Development Engineer in Test, you'll lead testing efforts, create automated tests for web applications, and enhance quality processes on a new product team.
Top Skills: AWSCypressDockerGatlingGraphQLJavaScriptJestJunitK6KafkaKubernetesPlaywrightPostgresPythonRedisRestSQLTypescript

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account