Braintrust
Posted 1y ago

Open Source Engineer - Python

Braintrust
San Francisco, California, United States
OnsiteFull Time
Responsibilities
  • Build SDKs
  • Improve libraries
  • Integrate providers
Requirements
  • Python expert
  • Experience building and maintaining open-source SDKs
  • Strong testing, packaging, and CI/CD
  • Knowledge of observability
  • OpenTelemetry experience bonus
Technical tools mentioned
PythonOpenTelemetryCI/CDTesting frameworksPackaging

Job description

About the company

Braintrust is building the modern platform for evaluating and deploying AI systems. Our mission is to help enterprises build trust in their AI by making it easy to test, monitor, and improve models using real-world evaluation frameworks. We work with cutting-edge customers in finance, healthcare, and tech who are building production-grade AI systems.

About the Role

We’re hiring engineers to build the open-source libraries that customers use to observe, understand, and optimize how AI operates inside their production applications. These SDKs are a critical part of Braintrust’s platform. They power evaluation and observability pipelines across a wide range of environments, frameworks, and AI providers.

This role is ideal for engineers who are passionate about developer experience, API craftsmanship, and building fast, reliable, and idiomatic libraries. You’ll own the full SDK lifecycle: design, implementation, release, documentation, and community support. Your work will be embedded in thousands of applications and help define how AI is adopted and operationalized across industries.

What You’ll Do

  • Build elegant, idiomatic, and resilient SDKs that power Braintrust’s LLM evaluation and AI observability platform.

  • Ensure our libraries are easy to use, efficient to run, and a delight to work with, prioritizing developer experience and performance.

  • Integrate with major AI providers, frameworks, and platforms our customers rely on, such as OpenAI, Anthropic, and Gemini.

  • Build tools and automation to improve testing, profiling and simplify release workflows.

  • Collaborate closely with backend, platform, and product teams to ensure a cohesive and polished developer experience.

  • Be a great community ambassador: talk with our users, understand their issues, help them get their fixes merged and have deep empathy for our users.

You Might Be a Fit If You:

  • Are customer-obsessed and passionate about solving real-world problems for developers.

  • Have deep expertise in Python and understand what it takes to build fast, idiomatic, and reliable libraries in that ecosystem.

  • Are proficient with the tooling needed to build robust SDKs, such as testing frameworks, profilers, CI/CD pipelines, and packaging systems.

  • Care deeply about developer experience, from clean APIs and clear docs to thoughtful error handling and backward compatibility.

  • Know how to wrap, patch, or extend existing frameworks and SDKs to inject observability and control without breaking developer workflows.

  • Have experience maintaining or contributing to production-grade open-source libraries, ideally used across multiple environments.

  • Bonus: You’ve contributed to popular open source projects, led SDK adoption at your organization, are familiar with tracing and observability tools like OpenTelemetry, or worked on tools in the LLM/AI ecosystem.

Benefits include

  • Medical, dental, and vision insurance

  • 401k plan

  • Daily lunch, snacks, and beverages

  • Flexible time off

  • Competitive salary and equity

  • AI Stipend

Equal opportunity

Braintrust is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

About Braintrust

Platform for evaluating and monitoring AI model performance.

Year founded
2023

Similar jobs

Open Source Engineer roles near San Francisco, California
9mo
Save
Mark Applied
Hide
Senior Open Source Engineer
San Francisco, California, United States
$180k-$250k/yr RemoteFull Time
LanceDB
LanceDB: Vector database for multimodal AI search and retrieval.
10+ YOE10+ years building high-performance databases/big data systems; deep understanding of open-source big data/AI stacks; strong Java/Scala HPC experience; experience with Rust; proven fast, independent contributor.
Java, Scala, Rust, Hadoop, Spark, Flink, Ray, Iceberg, Delta Lake, Hudi, Trino, Presto, PyTorch, JAX, Apache Arrow, DataFusion, Parquet
1mo
Save
Mark Applied
Hide
Sr. Open Source Software Engineer (Kafka) (Morrisville, NC, US)
Morrisville or San Jose or Raleigh or Boston or Seattle or Cork or Schiphol
$220k-$265k/yr HybridFull Time
NetApp
NetAppNASDAQ: NTAP: Sells enterprise data storage and cloud management software.
12+ YOEApache Kafka committer with 12+ years software engineering experience, expert Java in distributed systems, deep Kafka internals mastery, KIP authoring and open-source governance experience, strong written communication and mentoring skills.
Apache Kafka, Java, Jira, Kubernetes, Kafka Streams, Kafka Connect, MirrorMaker 2, Strimzi, CI
1mo
Save
Mark Applied
Hide
Sr. Open Source Software Engineer (Kafka)
San Jose or Raleigh or Waltham or Seattle or Cork or Schiphol
$220k-$265k/yr HybridFull Time
NetApp
NetAppNasdaq: NTAP: Provides intelligent data infrastructure for hybrid cloud environments.
12+ YOE12+ years software engineering experience, Apache Kafka committer status, expert Java skills, deep Kafka internals knowledge, strong written communication, ability to lead KIP-level design and upstream contributions.
Apache Kafka, Kafka Streams, Kafka Connect, MirrorMaker 2, Java, Jira, Kubernetes
1w
Save
Mark Applied
Hide
Open Source Research Software Engineer: User Interfaces (0652) Job#88093 - BIDS
Berkeley, California, United States
$102k-$190k/yr OnsiteFull Time
University of California, Berkeley
University of California, Berkeley: Public research university offering undergraduate and graduate education.
Bachelor's degree or equivalent experience, advanced Python and TypeScript, user-interface design, Git, testing, GitHub Actions, secure development, open-source collaboration, complex data analysis, deployment, communication, and problem-solving skills.
Python, TypeScript, Git, GitHub Actions, GitHub, JupyterLab, Project Jupyter, R, Scientific Python, BioJupyter
3mo
Save
Mark Applied
Hide
Opensource Al workload Software Engineer
San Jose or United States
OnsiteFull Time
AMD
AMDNASDAQ: AMD: Designs and manufactures computer processors and graphics technology.
Experience in AI software, kernel optimization, and open-source frameworks; strong collaboration and leadership skills.
RoCm, ATen, Pytorch, JAX, Triton, HIP, CUDA, PTX, SASS, XLA, SGLang, vLLM, Open source