HiringCafe
Join our community

87 evaluation lead jobs at 58 companies in San Francisco, CA

2mo
Save
Mark Applied
Hide
Technical Lead, Evaluation Infrastructure
Mountain View, California, United States
$194k-$291k/yr OnsiteFull Time
Nuro
Nuro: Builds autonomous driving software and electric delivery robots.
4+ YOEDegree in BSc/MSc with 4+ years in distributed systems, ML eval pipelines; leadership; Python/C++ proficiency.
Python, C++, Machine Learning, Data pipelines, CI/CD
Job PostingView all
3mo
Save
Mark Applied
Hide
Behavior & Training Lead
Oakland, California, United States
$24-$26/hr OnsiteFull Time
East Bay SPCA
East Bay SPCA: Provides animal shelter, veterinary care, and pet adoption services.
Lead shelter behavior program; supervise staff, run evaluations, train volunteers; ensure humane handling and adherence to policies.
Trello, Shelter Buddy, Microsoft Office, Training tools
Job PostingView all
3w
Save
Mark Applied
Hide
Technical Program Manager, Evaluation & Validation
Sunnyvale, California, United States
$215k-$274k/yr HybridFull Time
Wayve
Wayve: Develops end-to-end artificial intelligence for autonomous driving systems.
8+ YOE8+ years leading complex multi-team programs; technical credibility in simulation, evaluation, ML; strong program management, communication, data-driven decision-making, and systems thinking.
Jira
Job PostingView all
2mo
Save
Mark Applied
Hide
Talent Lead
San Francisco, California, United States
OnsiteFull Time
Lapel
Lapel: Unifying customer data to power personalized service at scale.
3+ YOE3+ years recruiting across technical and non-technical roles; owned end-to-end hiring; strong sourcing, candidate evaluation, and stakeholder partnership skills; comfortable working with founders and moving quickly.
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Software Development Engineer in Test — LLM Evaluation & Automation, T3E
Cupertino, California, United States
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
Senior SDET to lead design and implementation of automated model evaluation, build LLM evaluation pipelines and infrastructure, and partner with modeling, framework, and infrastructure teams.
Job PostingView all
1mo
Save
Mark Applied
Hide
Science Lead, Intercept
New York City or San Francisco or United States
RemoteFull Time
Stripe
Stripe: Provides online payment processing and financial infrastructure for businesses.
5+ YOEPhD or MD in immunology/infectious disease with 5+ years post-grad research; portfolio management, grant/investment experience; product development and project management; strong scientific evaluation and communication skills.
CRM
Job PostingView all
1mo
Save
Mark Applied
Hide
AI Operations Lead
San Francisco, California, United States
$150k-$190k/yr OnsiteFull Time
Squint
Squint: AI and AR platform for frontline manufacturing workers.
2+ YOE2+ years in operations/strategy/TPM or applied AI, hands-on experience building and shipping AI tools or agents, familiarity with agent tooling, light coding ability, strong communication and evaluation skills.
Cursor, Claude Code
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Partnerships Lead
Palo Alto or Los Angeles
$131k-$247k/yr OnsiteFull Time
Tencent
TencentHong Kong Stock Exchange: 0700: Global provider of internet services and digital technology solutions.
Design end-to-end data acquisition strategies, manage vendor relationships, own data pipelines, set quality/evaluation metrics, and navigate data governance (including CCPA/CPRA) for AI research initiatives.
Job PostingView all
4w
Save
Mark Applied
Hide
Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)
McLean or San Francisco or New York City or San Jose or Cambridge
$230k-$286k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
4+ YOEBachelor's plus 6 years or master's plus 4 years in AI/ML development; 6 years programming in Python, Go, Scala, or Java; experience building scalable AI systems and leading engineering teams.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff/Lead Data Scientist (Model Evaluation) - TikTok Integrity and Safety (San Jose)
San Jose, California, United States
$219k-$422k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
5+ YOE5+ years data science experience, Bachelor's degree, strong SQL and Python/R skills, visualization, ML knowledge, causal inference and A/B testing experience, experiment evaluation and mentoring experience.
SQL, Python, R
Job PostingView all
3w
Save
Mark Applied
Hide
Technical Program Manager, Evaluation & Validation
Sunnyvale or London
$215k-$274k/yr HybridFull Time
Wayve
Wayve: Develops AI software for autonomous vehicle navigation.
8+ YOE8+ years leading complex multi-team programs, strong technical credibility with simulation/ML teams, program and risk management, data-driven decision making, clear communication and systems thinking.
Jira
Job PostingView all
1w
Save
Mark Applied
Hide
GenAI Technical Engagement Lead, DeepMind
Mountain View, California, United States
$277k-$308k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
8+ YOEBachelor's degree or equivalent practical experience; 8 years in technical, engineering, research, policy, or regulatory roles; experience with foundational model lifecycles, training data, evaluation, deployment, and cross-functional teams.
Job PostingView all
1mo
Save
Mark Applied
Hide
Case Study Training Lead - 6384145
San Francisco, California, United States
$70-$80/hr OnsiteFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
5+ YOEMinimum 5 years' experience designing and delivering training curricula, onboarding and competency validation, training documentation/versioning, data-driven evaluation of training effectiveness, and coaching staff.
Job PostingView all
1w
Save
Mark Applied
Hide
New Geography and International Growth Lead
United States or Seattle or San Francisco
$181k-$285k/yr RemoteFull Time
OpenAI
OpenAI: Develops artificial intelligence models and generative AI software services.
8+ YOERequires 8+ years in infrastructure strategy, site selection, energy, data centers, economic development, corporate development, international expansion, or related work, plus market evaluation and cross-functional coordination experience.
Job PostingView all
4w
Save
Mark Applied
Hide
Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)
McLean or San Francisco or Cambridge or San Jose or New York City
$230k-$286k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
6+ YOEBachelor's plus 6+ years (or Master's plus 4+ years) developing AI/ML systems; strong programming (Python, Go, Scala, Java); cloud AI deployment experience; leadership and research application skills.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure
Job PostingView all
4w
Save
Mark Applied
Hide
Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)
McLean or San Francisco or New York City or San Jose or Cambridge
$230k-$286k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years in AI/ML; 6 years programming with Python, Go, Scala, or Java; cloud AI deployment and team leadership preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, AWS, Google Cloud, Azure, C++, C#, Golang
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Technical Lead Manager, Prediction & Planning, ML Eval
Mountain View or San Francisco
$251k-$310k/yr HybridFull Time
Waymo
Waymo: Autonomous driving technology for ride-hailing and logistics.
5+ YOE3+ MgmtMS in CS/Math or equivalent; 5+ years distributed infra; 3+ years engineering management; strong Python/C++; ML evaluation knowledge; familiarity with ML deployment/ orchestration tools.
Python, C++, TensorFlow, JAX, Flax, Apache Beam, TF Serving, TorchServe, Kubeflow, SageMaker Pipelines, Vertex AI Pipelines, PyTorch, TensorFlow
Job PostingView all
3w
Save
Mark Applied
Hide
Evals Infrastructure Tech Lead / Manager
San Francisco, California, United States
$500k-$850k/yr HybridFull Time
Anthropic
Anthropic: Developing safe and reliable artificial intelligence systems.
Lead distributed-systems infrastructure for model evaluation; 1+ years managing engineers or tech-lead-with-reports; strong Python and Rust; experience with high-throughput fault-tolerant systems; bachelor\u0002s or equivalent.
Python, Rust
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Silicon and System Product Lead
Santa Clara, California, United States
$196k-$368k/yr HybridFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
12+ YOEBS/MS in EE/CE/CS/Systems or equivalent; 12+ years in product performance and power evaluations; experience with system-level features, product binning, data analysis/statistics, NPI, critical path and power/performance analysis, silicon bringup/validation, and offshore collaboration.
Job PostingView all
1mo
Save
Mark Applied
Hide
Product Evaluations Lead - Gen AI Software
Santa Clara, California, United States
$224k-$357k/yr HybridFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
12+ YOE12+ years in data science/model evaluation/experimentation, Master's/PhD or equivalent, proven model evaluation for go/no-go decisions, hands-on Python and statistical/experimental methods, LLM/GenAI benchmarking experience.
Python
Job PostingView all

Explore Jobs

Expand Your Job Search