ByteDance
Posted 1mo ago

Senior Software Engineer, AI Infrastructure - Developer Tooling

ByteDance
San Jose, California, United States
OnsiteFull Time
Responsibilities
  • designing retrieval
  • building agents
  • evaluating benchmarks
Requirements
  • Bachelor's in CS/EE or equivalent
  • 4+ years software engineering
  • Strong Python and TypeScript/JavaScript
  • Experience with C++/Rust/Go
  • LLM integration and retrieval systems knowledge
Technical tools mentioned
PythonTypeScriptJavaScriptC++RustGoBM25ASTvector searchvector databaseLLMs

Job description

About the Team
We're building the AI-powered backbone of our developer tools. You'll work on three core systems: a retrieval infrastructure powering our AI products, a coding agent that assists users in writing code, and the evaluation frameworks that measure their effectiveness.

Responsibilities
Retrieval Systems (RAG Infrastructure)
- Design and scale retrieval pipelines including vector search, BM25, and hybrid retrieval strategies
- Build and optimize embedding pipelines, chunking strategies, and re-ranking systems
- Develop query understanding and rewriting components to improve retrieval relevance
- Manage vector database infrastructure at production scale

Coding Agent Development
- Build agent architectures that support multi-step code generation, refactoring, debugging, and diagnostics
- Implement tool-use patterns (function calling, code execution sandboxing, file system interaction)
- Develop context management strategies for long-form code understanding

Evaluation & Benchmarking
- Design and maintain evaluation frameworks for retrieval quality and agent task completion
- Build custom benchmark suites for real-world coding task assessment
- Create reproducible testing infrastructure with automated regression detection

Minimum Qualifications
- Bachelor's degree in CS, EE, or related field (or equivalent experience)
- 4+ years of software engineering experience
- Strong proficiency in Python (primary) and TypeScript/JavaScript
- Experience with at least one systems-level language (C++, Rust, Go)
- Practical experience integrating LLMs into applications (prompt engineering, context management, output parsing)
- Understanding of agent patterns: tool use, multi-turn reasoning, error recovery
- Familiarity with code-specific LLM tasks (generation, summarization, analysis)

Preferred Qualifications
- Master's or Ph.D. in Computer Science, Machine Learning, or related field
- Contributions to open-source developer tooling, retrieval systems, or coding assistants
- Experience with AST parsing, code analysis tools, or language servers
- Familiarity with rendering pipelines or cross-platform framework architecture
- Experience deploying and optimizing ML models in production (latency, cost, reliability)

About ByteDance

Developing AI-driven content platforms and mobile applications.

Similar jobs

Software Engineer roles near San Jose, California
5h
Save
Mark Applied
Hide
Staff+ Software Engineer, Platform Ecosystem
San Francisco or New York City
$405k-$485k/yr HybridFull Time
Anthropic
Anthropic: Developing safe and reliable artificial intelligence systems.
8+ YOEBachelor's degree or equivalent experience; 8+ years of backend or platform engineering experience, some frontend experience, product sense, AI development tools familiarity, and independent ownership of scalable products.
AI tools
8h
Save
Mark Applied
Hide
Software Engineer, Applied AI
San Francisco, California, United States
$150k-$250k/yr OnsiteFull Time
Clera
Clera: AI talent agent matching professionals with high-growth startup roles
3+ YOERequires a few years of software engineering experience, production systems, AI agent evaluations, full-stack applications, cross-functional ownership, and direct LLM or applied AI experience.
Temporal, Prefect
22h
Save
Mark Applied
Hide
Software Engineer, Onboard
San Francisco, California, United States
$176k-$242k/yr OnsiteFull Time
Atoms
Atoms: Building robotics and software to automate physical world industries.
Proficiency in Python, C++, Bash, Git, Linux kernels, and Docker, with experience in diagnostics, IPC, sensor interfaces, networking, profiling, benchmarking, and memory management.
Python, C++, Bash, Git, Linux kernels, Docker, dmesg, systemd, journalctl, PTP, LiDAR, radar, cameras, IMU
22h
Save
Mark Applied
Hide
Software Engineer, Onboard
San Francisco, California, United States
$176k-$242k/yr OnsiteFull Time
Atoms
Atoms: Building specialized industrial robots and physical AI systems.
Proficiency in Python, C++, bash, git, Linux kernels, and Docker; experience with IPC, sensor interfaces, profiling, benchmarking, memory management, networking, and vehicle software systems.
Python, C++, Bash, Git, Linux, Docker, dmesg, systemd, journalctl, PTP, LiDAR, radar, cameras, IMU
1d
Save
Mark Applied
Hide
Staff Software Engineer - Data Platform - Kubernetes - Distributed Systems - Federal
San Diego or San Francisco or Pleasanton or Santa Clara or Kirkland or United States
$150k-$262k/yr HybridFull Time
ServiceNow
ServiceNowNYSE: NOW: Provides a cloud platform for automating enterprise digital workflows.
8+ YOERequires 8+ years software development with a bachelor's, 5+ with a master's, 3+ with a PhD, or equivalent; 5+ years Kubernetes; hyperscaler experience; Go; containers; CI/CD; GitOps; infrastructure-as-code.
Kubernetes, AWS, Azure, GCP, containers, CI/CD, GitOps, infrastructure-as-code, Go, CNI, service mesh, mTLS, observability, metrics, tracing, dashboards, AI
1d
Save
Mark Applied
Hide
Staff Software Engineer - Data Platform - Kubernetes - Distributed Systems - Federal
San Diego or San Francisco or Pleasanton or Santa Clara or Kirkland
$150k-$262k/yr HybridFull Time
ServiceNow
ServiceNowNYSE: NOW: Enterprise cloud platform for digital workflow automation.
3+ YOERequires 8+ years software development with a bachelor's, 5+ with a master's, 3+ with a PhD, or equivalent; 5+ years Kubernetes; hyperscaler, Go, containers, CI/CD, GitOps, and infrastructure-as-code experience.
Kubernetes, AWS, Microsoft Azure, Google Cloud Platform (GCP), Go, CI/CD, GitOps, Git, infrastructure-as-code, CNI, service mesh, mTLS
1d
Save
Mark Applied
Hide
Software Engineer (Hybrid)
North Carolina or San Jose or New York or Washington
$129k-$185k/yr HybridFull Time
Cisco
CiscoNASDAQ: CSCO: Develops and sells networking hardware and cybersecurity software.
6+ YOEBachelor's degree in computer science, information technology, or related field; 6+ years as a Salesforce Developer; Salesforce architecture, Apex, LWC, SOQL, integrations, Git, CI/CD, and AI tooling experience.
Salesforce, Apex, Visualforce, Lightning, Lightning Component Framework, LWC, SOQL, REST, SOAP, Git, CI/CD, JavaScript, HTML, CSS, Salesforce Agentforce, Service Cloud, Sales Cloud
1d
Save
Mark Applied
Hide
Senior Fullstack Software Engineer, DX
San Francisco, California, United States
$149k-$235k/yr HybridFull Time
Atlassian
AtlassianNASDAQ: TEAM: Develops software for team collaboration and project management.
7+ YOERequires 7+ years building backend applications, fullstack experience, a bachelor's or master's degree or equivalent experience, programming proficiency, REST microservices, databases, cloud, and strong communication skills.
Ruby on Rails, SQL, React, Tailwind CSS, REST, Java, Kotlin, Go, Scala, Python, JavaScript, TypeScript, Node, Postgres, DynamoDB, AWS