Braintrust Logo

Braintrust

Open Source Engineer - Python

Reposted 6 Hours Ago
In-Office or Remote
4 Locations
Mid level
In-Office or Remote
4 Locations
Mid level
Develop and maintain open-source SDKs for AI observability and evaluation, ensuring efficiency, user-friendliness, and compatibility across frameworks.
The summary above was generated by AI
About the company

Braintrust is the AI observability platform. By connecting evals and observability in one workflow, Braintrust gives builders the visibility to understand how AI behaves in production and the tools to improve it.

Teams at Notion, Stripe, Zapier, Vercel, and Ramp use Braintrust to compare models, test prompts, and catch regressions — turning production data into better AI with every release.

About the Role

We’re hiring engineers to build the open-source libraries that customers use to observe, understand, and optimize how AI operates inside their production applications. These SDKs are a critical part of Braintrust’s platform. They power evaluation and observability pipelines across a wide range of environments, frameworks, and AI providers.

This role is ideal for engineers who are passionate about developer experience, API craftsmanship, and building fast, reliable, and idiomatic libraries. You’ll own the full SDK lifecycle: design, implementation, release, documentation, and community support. Your work will be embedded in thousands of applications and help define how AI is adopted and operationalized across industries.

What You’ll Do
  • Build elegant, idiomatic, and resilient SDKs that power Braintrust’s LLM evaluation and AI observability platform.

  • Ensure our libraries are easy to use, efficient to run, and a delight to work with, prioritizing developer experience and performance.

  • Integrate with major AI providers, frameworks, and platforms our customers rely on, such as OpenAI, Anthropic, and Gemini.

  • Build tools and automation to improve testing, profiling and simplify release workflows.

  • Collaborate closely with backend, platform, and product teams to ensure a cohesive and polished developer experience.

  • Be a great community ambassador: talk with our users, understand their issues, help them get their fixes merged and have deep empathy for our users.

You Might Be a Fit If You:
  • Are customer-obsessed and passionate about solving real-world problems for developers.

  • Have deep expertise in Python and understand what it takes to build fast, idiomatic, and reliable libraries in that ecosystem.

  • Are proficient with the tooling needed to build robust SDKs, such as testing frameworks, profilers, CI/CD pipelines, and packaging systems.

  • Care deeply about developer experience, from clean APIs and clear docs to thoughtful error handling and backward compatibility.

  • Know how to wrap, patch, or extend existing frameworks and SDKs to inject observability and control without breaking developer workflows.

  • Have experience maintaining or contributing to production-grade open-source libraries, ideally used across multiple environments.

  • Bonus: You’ve contributed to popular open source projects, led SDK adoption at your organization, are familiar with tracing and observability tools like OpenTelemetry, or worked on tools in the LLM/AI ecosystem.

Benefits include
  • Medical, dental, and vision insurance

  • Daily lunch, snacks, and beverages

  • Flexible time off

  • Competitive salary and equity

  • AI Stipend

Equal opportunity

Braintrust is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Top Skills

Python

Similar Jobs

24 Days Ago
In-Office or Remote
8 Locations
Mid level
Mid level
Software
As a Software Engineer, you'll enhance the user experience of ML tools, optimize workflows, and collaborate with product managers on ML infrastructure projects.
Top Skills: Deep LearningMlopsPython
8 Minutes Ago
Remote or Hybrid
United States
58K-65K Annually
Mid level
58K-65K Annually
Mid level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The Financial Consultant I manages financial support for Regional Market clients, including billing, audits, and client implementation, while analyzing financial data and trends.
Top Skills: ExcelMS Office
2 Hours Ago
Easy Apply
Remote
USA
Easy Apply
175K-250K Annually
Senior level
175K-250K Annually
Senior level
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Lead the engineering team for product delivery at Runpod, focusing on customer-facing features while managing roadmaps, team growth, quality, and cross-functional collaboration.
Top Skills: Cloud Systems EngineeringGoKubernetesLinuxPythonTypescript

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account