HiringCafe
Join our community

585 evaluations engineer jobs at 281 companies in Redwood City, CA

2mo
Save
Mark Applied
Hide
Evaluations Engineer
San Francisco, California, United States
$130k-$165k/yr OnsiteFull Time
Vals AI
Vals AI: AI evaluation platform that benchmarks language models and agents on real-world professional tasks for labs and enterprise teams.
Strong engineering fundamentals, professional Python expertise, familiarity with LLMs, Git workflow experience, ability to analyze model error modes and work with cross-functional teams. In-person in San Francisco; relocation/transportation support provided.
Docent, Python, Django, React, AWS, CDK, Git
Job PostingView all
2mo
Save
Mark Applied
Hide
Field Evaluations Engineer - Northern California
Fremont or San Jose or Brea or California
$97k-$120k/yr FieldFull Time
UL Solutions
UL SolutionsNYSE: ULS: Global leader in applied safety science testing and certification.
8+ YOEBachelor's in an ABET-accredited engineering field, 8 years related experience, expert knowledge of NEC/building codes, electrical test equipment, hazard-based engineering, frequent travel and ability to work remotely.
Electrical Test Equipment
Job PostingView all
3mo
Save
Mark Applied
Hide
AI Evaluations Engineer
San Francisco, California, United States
$160k-$210k/yr RemoteFull Time
Ellipsis Health
Ellipsis Health: Healthcare AI providing an emotionally intelligent voice care manager for health plans and health systems.
5+ YOE5+ years software engineering; backend systems; production infrastructure; CI/CD; observability; debugging; collaboration across teams.
Python, TypeScript, Java, CI/CD, APIs, Data Pipelines, Observability Tools
Job PostingView all
1mo
Save
Mark Applied
Hide
Evaluations Engineering - Member of Technical Staff
San Francisco, California, United States
$200k-$400k/yr OnsiteFull Time
Simile
Simile: Private AI providing human-behavior simulation software to enterprises and public organizations.
Several years building production backend and data systems, experience with evaluation pipelines, ML/LLM fluency, strong system design and communication skills.
Job PostingView all
1mo
Save
Mark Applied
Hide
Research Engineer - Evaluations
Redwood City, California, United States
HybridFull Time
Luma AI
Luma AI: AI is a private creative AI platform generating video and images for creators and teams.
5+ YOE5+ years building ML evaluation systems or large-scale model pipelines; master's/PhD or equivalent; experience with visual data; proficiency in Python and PyTorch/JAX/TensorFlow; strong software engineering and distributed systems skills.
Python, PyTorch, JAX, TensorFlow, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Member of Technical Staff - Research Software Engineer - Safety Evaluations Infrastructure
New York City or San Francisco or London
OnsiteFull Time
Reflection AI
Reflection AI: Private AI research lab building open foundation models and agentic software for enterprise, government, and regulated-industry users.
Experience building secure, isolated infrastructure for sensitive model evaluations; strong Python skills; security engineering fundamentals; data pipeline and sandboxing experience.
Python
Job PostingView all
3mo
Save
Mark Applied
Hide
Staff Software Engineer, Quantitative Evaluations
Mountain View or San Francisco
$251k-$310k/yr HybridFull Time
Waymo
Waymo: Autonomous driving technology and robotaxi service provider.
4+ YOEBS in a quantitative field; 4-7 years experience; strong C++, Python, SQL skills; data analysis; building data pipelines; ML familiarity; strong coding standards.
C++, Python, SQL, Machine Learning, Data Processing, Statistics
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Engineering Manager, Agentic & Generative AI Benchmarking and Evaluations
Santa Clara, California, United States
$201k-$352k/yr OnsiteFull Time
ServiceNow
ServiceNowNYSE: NOW: Enterprise software providing cloud-based workflow automation platforms.
8+ YOE3+ Mgmt8+ years software/ML engineering experience with 3+ years managing AI/ML teams; expertise in LLM evaluation, benchmarking, Python, SQL, Pandas, NumPy, and ML evaluation metrics.
Python, SQL, Pandas, NumPy, ROUGE, BLEU, G-Eval, OpenAI, Anthropic, Google
Job PostingView all
2mo
Save
Mark Applied
Hide
AI Engineer, Evaluation
San Francisco or New York City
$150k-$250k/yr HybridFull Time
Distyl AI
Distyl AI: Architecting the AI-Native Enterprise
2+ YOE2+ years software engineering, strong Python, experience with evaluation- or experiment-driven development, ability to encode human judgment into tests/graders, systems-oriented mindset, and willingness to travel 10–50%.
Python, LLM
Job PostingView all
2w
Save
Mark Applied
Hide
Electrical Engineer
Sunnyvale, California, United States
$74k-$116k/yr OnsiteFull Time
Abbott
AbbottNYSE: ABT: Global healthcare technology focused on life-changing medical innovations.
3+ YOEBachelor's degree in electrical, electronic, or related engineering; 3+ years designing and evaluating PCBs, fixtures, and tools; experience with testing, documentation, FDA requirements, and engineering laboratory equipment.
Printed Circuit Boards (PCBs), oscilloscopes, spectrum analyzers, arbitrary waveform generators, function generators, LCR meters, power supplies, embedded systems, DSP, SPICE, Matlab, COMSOL, spreadsheet, word processing, database management
Job PostingView all
3w
Save
Mark Applied
Hide
Founding Research Engineer
New York City or San Francisco
$215k-$330k/yr OnsiteFull Time
Ambral
Ambral: AI customer-success platform for businesses that monitors accounts, identifies churn and expansion opportunities, and automates follow-up actions.
4+ YOE4+ years building production software or ML systems, including 2+ years with RL environments or evaluation/agent infrastructure; strong software engineering, data processing, reproducibility, and evaluation skills.
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Engineer, Design Evaluation Engineering
San Jose, California, United States
$157k-$188k/yr OnsiteFull Time
Analog Devices
Analog DevicesNASDAQ: ADI: Global leader in analog and digital semiconductor technology.
1+ YOEMaster’s degree in Electrical Engineering and 1 year of relevant design evaluation experience; proficient in C#/C++, Python, and PCB design tools; able to automate tests and analyze results.
C#, C++, Python, Visual Studio, OrCAD, Cadence Allegro, Microsoft Office, PCB schematic capture, PCB layout
Job PostingView all
2w
Save
Mark Applied
Hide
AI Engineer – Algorithm Evaluation & Agentic Systems
Sunnyvale, California, United States
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designing and manufacturing consumer electronics, software, and digital services.
Experience evaluating AI algorithms and designing agentic systems, with system-level reasoning, metric definition, engineering rigor, and clear technical communication.
Job PostingView all
2w
Save
Mark Applied
Hide
Electrical Engineer
Sunnyvale, California, United States
$74k-$116k/yr OnsiteFull Time
Abbott
AbbottNYSE: ABT: Global healthcare technology focused on life-changing medical innovations.
3+ YOEBachelor's degree in electrical, electronic, or related engineering and 3+ years of PCB, fixture, and tool construction and evaluation experience. Requires FDA compliance, testing, documentation, communication, and analytical skills.
Printed Circuit Boards (PCBs), oscilloscopes, spectrum analyzers, arbitrary waveform generators, function generators, LCR meters, power supplies, embedded systems, DSP, SPICE, Matlab, COMSOL
Job PostingView all
3d
Save
Mark Applied
Hide
Component Engineer Stf - E4
Sunnyvale, California, United States
$131k-$244k/yr OnsiteFull Time
Lockheed Martin
Lockheed MartinNYSE: LMT: Global security and aerospace driving innovative defense solutions.
Experience in parts or component engineering and evaluating high-reliability parts; knowledge of EEE, materials, processes, specifications, qualification data, and engineering requirements. Master's degree preferred.
Microsoft Excel, AI
Job PostingView all
2d
Save
Mark Applied
Hide
Supplier Engineer IV
Santa Clara, California, United States
$134k-$184k/yr OnsiteFull Time
Applied Materials
Applied MaterialsNASDAQ: AMAT: Global leader in materials engineering for the semiconductor industry.
Expertise in a specialized engineering discipline; ability to lead supplier audits, resolve complex quality problems, evaluate capabilities, negotiate solutions, and apply analytical judgment.
Job PostingView all
2w
Save
Mark Applied
Hide
AI Engineer
Mountain View, California, United States
OnsiteFull Time
AI Fund
AI Fund: AI Fund is a privately held venture studio that-founds early-stage artificial-intelligence companies with entrepreneurs and partners.
3+ YOERequires 3+ years of software engineering experience, production LLM systems experience, strong Python and/or TypeScript/Node skills, and experience with LLM APIs, agentic workflows, evaluation, and end-to-end services.
Claude, OpenAI, Python, TypeScript, Node
Job PostingView all
3mo
Save
Mark Applied
Hide
Lead AI Engineer — Productivity Systems
Durham or Miami or Palo Alto or Washington
$12k-$18k/mo HybridFull Time
Nubank
NubankNYSE: NU: Brazilian digital bank serving consumers and small businesses with credit cards, accounts, payments, lending, investments, and insurance.
Proven experience shipping LLM-powered systems in production; strong prompt/context engineering, evaluation and guardrail development, and software engineering skills (Python/TypeScript/Clojure).
Python, TypeScript, Clojure, n8n, Zapier, AWS, Claude Code, Cursor, Copilot, Slack, Google Workspace, Jira, Terraform, RAG, MCP
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Engineering Manager, Agentic & Generative AI Benchmarking and Evaluations
Santa Clara, California, United States
$201k-$352k/yr OnsiteFull Time
ServiceNow
ServiceNowNYSE: NOW: Enterprise software providing cloud-based workflow automation platforms.
8+ YOE3+ MgmtRequires 8+ years of software engineering or machine learning experience, 3+ years leading AI/ML teams, Python, SQL, Pandas, NumPy, AI evaluation metrics, MLOps platforms, and a bachelor's degree in a quantitative field.
OpenAI, Anthropic, Google, ROUGE, BLEU, G-Eval, Python, SQL, Pandas, NumPy, MLOps, Knowledge Graphs, CMDBs, RAG
Job PostingView all
3w
Save
Mark Applied
Hide
Forward Deployed Engineer
Mountain View or San Francisco
$160k-$220k/yr OnsiteFull Time
Granica
Granica: AI research and products building data infrastructure and models for enterprises.
5+ YOERequires 5+ years in sales engineering, solutions architecture, forward deployed or data engineering; expertise in data platforms, distributed systems, cloud infrastructure, SQL, and programming; enterprise evaluations and deployments experience.
Apache Spark, Apache Iceberg, Delta Lake, Trino, Presto, SQL, Large Tabular Models (LTMs)
Job PostingView all

Explore Jobs

Expand Your Job Search