B
Posted 2mo ago

Software Engineer, Developer Experience

Braintrust
San Francisco or New York City or Seattle
OnsiteFull Time
Responsibilities
  • removing friction
  • optimizing CI
  • owning deploys
Requirements
  • 5+ years building developer tools/CI/CD/platform infrastructure
  • Deep GitHub expertise
  • Strong fluency with JavaScript/TypeScript build tools
  • Supply chain security and profiling experience
Technical tools mentioned
GitHub ActionsGitHub AppsGitHub APIsJavaScriptTypeScriptesbuildswcViteTurbopacktscpnpmSBOMsSigstorecosignSLSA

Job description

About the company

Braintrust is the AI observability platform. By connecting evals and observability in one workflow, Braintrust gives builders the visibility to understand how AI behaves in production and the tools to improve it.

Teams at Notion, Stripe, Zapier, Vercel, and Ramp use Braintrust to compare models, test prompts, and catch regressions — turning production data into better AI with every release.

About the role

We're looking for an Engineer who loves building tools for other engineers. You'll own the systems we touch every day — local dev, CI, and the deploy pipeline — and make shipping to production fast, safe, and reliable. The work compounds across every engineer at the company and is very important to our whole team

What you'll do

  • Work directly with the engineering team to find friction and remove it — help them be nimble, happy and productive

  • Drive CI runtime down: parallelization, caching, sharding, test selection, and killing flakes

  • Own the deploy pipeline: progressive rollouts, fast rollbacks, and clear signals when something is wrong

  • Own the our build toolchain — bundlers, compilers, monorepo tooling — and keep cold builds and rebuilds fast as the codebase and archictecture grows

  • Harden our supply chain: SBOMs, signed artifacts, locked-down GitHub Actions, secret hygiene, and provenance for every build

  • Build CLIs, GitHub Apps, and bots that make the right thing the easy thing

Ideal candidate credentials

  • 5+ years building developer tools, CI/CD, or platform infrastructure

  • A track record of taking slow, painful workflows and making them fast and pleasant

  • Deep GitHub expertise: Actions, Apps, APIs, merge queues, and branch protections

  • Strong fluency with JavaScript/TypeScript build and bundling tools (esbuild, swc, Vite, Turbopack, tsc, pnpm) and a clear sense of when to reach for which

  • Comfortable profiling and optimizing across the stack — flamegraphs, tracing, and just plain measurement

  • Supply chain security experience: SBOMs, Sigstore/cosign, SLSA, GitHub Actions hardening

  • Strong opinions on safe, reliable production deploys

Benefits include

  • Medical, dental, and vision insurance

  • Daily lunch, snacks, and beverages

  • Flexible time off

  • Competitive salary and equity

  • AI Stipend

Equal opportunity

Braintrust is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

About Braintrust

Platform for evaluating and monitoring AI model performance.

Year founded
2023

Similar jobs

Software Engineer roles near San Francisco, California
2h
Save
Mark Applied
Hide
Software Engineer
San Francisco, California, United States
$167k-$235k/yr HybridFull Time
DocuSign
DocuSignNASDAQ: DOCU: Provides electronic signature and agreement management software solutions.
5+ YOEBachelor's degree in computer science or electrical engineering, or equivalent experience; 5+ years building large-scale applications; agile development and Git experience; strong problem-solving skills.
Git, Redis, Cassandra, Elasticsearch, C#, SQL, REST API, React, Scrum, Microsoft Azure, RabbitMQ, Azure Service Bus, CSS, AJAX, JSON, HTML, MVC, Microsoft .NET
4h
Save
Mark Applied
Hide
Senior Software Engineer, Google Cloud Security and Privacy
Sunnyvale, California, United States
$174k-$252k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
5+ YOEBachelor’s degree or equivalent practical experience; 5 years programming in C++, Java, or Go; software product development, security or privacy, distributed computing, and software architecture experience.
C++, Java, Go
5h
Save
Mark Applied
Hide
Senior Group Technical Architect
Heredia or San Francisco or Costa Rica
OnsiteFull Time
HCLTech
HCLTechNational Stock Exchange of India: HCLTECH: Global provider of information technology services and software consulting.
10+ YOE10+ years' experience; strong expertise in two backend languages, REST APIs, microservices, Kafka, AWS, Docker, Kubernetes, CI/CD, testing, observability, secure coding, and technical leadership.
Python, Node.js, C#, Go, Kafka, AWS, Docker, Kubernetes, REST APIs, CI/CD
7h
Save
Mark Applied
Hide
Software Engineer Graduate (Recommendation Infrastructure) - 2027 Start
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$128k-$317k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
Bachelor's degree in computer science or related discipline; strong programming in Go, C++, Java, or Python; knowledge of algorithms, operating systems, networking, and distributed systems.
Go, C++, Java, Python, Redis, Kafka
11h
Save
Mark Applied
Hide
Software Engineer, Intern
San Francisco, California, United States
$100k-$150k/yr OnsiteInternship, Full Time
Exa
Exa: Search engine infrastructure for artificial intelligence agents.
Currently pursuing a Computer Science, Engineering, Physics, or related technical degree; willing to work full time in San Francisco for a semester; experience with a high-performance language and technically difficult projects.
C++, Rust
11h
Save
Mark Applied
Hide
Software Engineer - AI Enablement
San Francisco, California, United States
$180k-$225k/yr OnsiteFull Time
Scale AI
Scale AI: Provides data and infrastructure for training artificial intelligence models.
3+ YOERequires 3+ years of software engineering experience, full-stack production ownership, TypeScript or Python, and familiarity with LLMs, embeddings, vector databases, distributed systems, and cloud architectures.
TypeScript, Python, LLMs, vector databases
13h
Save
Mark Applied
Hide
Senior Software Engineer
Bangalore or San Francisco or India
OnsiteFull Time
Rippling
Rippling: Unified platform managing workforce HR, IT, and finance operations
7+ YOERequires 7+ years of programming experience, backend architecture expertise, distributed systems experience, and proficiency or preferred experience with Python, Django, React, MongoDB, and AWS.
Python, Django, React, MongoDB, AWS
17h
Save
Mark Applied
Hide
Software Engineer (Multiple Positions)
San Jose, California, United States
$188k-$317k/yr OnsiteFull Time
ByteDance
ByteDance: Developing AI-driven content platforms and mobile applications.
1+ YOEMaster's degree plus 1 year, or bachelor's degree plus 3 years, in a relevant field. Requires 1 year each developing software, UI/scripts, debugging, service architecture, databases, and Unix/Linux.
Java, Go, C++, JavaScript, Ruby, Python, HTML, MySQL, Redis, Unix, Linux