310 evaluations engineer jobs at 123 companies in Tracy, CA
2mo
Save
Mark Applied
Hide
2mo
Field Evaluations Engineer - Northern California
Fremont or San Jose or Brea or California
$97k-$120k/yrFieldFull Time
UL SolutionsNYSE: ULS: Provides safety science testing, inspection, and certification services globally.
8+ YOEBachelor's in an ABET-accredited engineering field, 8 years related experience, expert knowledge of NEC/building codes, electrical test equipment, hazard-based engineering, frequent travel and ability to work remotely.
Luma AI: Develops multimodal AI for video generation and creative production.
5+ YOE5+ years building ML evaluation systems or large-scale model pipelines; master's/PhD or equivalent; experience with visual data; proficiency in Python and PyTorch/JAX/TensorFlow; strong software engineering and distributed systems skills.
Waymo: Autonomous driving technology for ride-hailing and logistics.
4+ YOEBS in a quantitative field; 4-7 years experience; strong C++, Python, SQL skills; data analysis; building data pipelines; ML familiarity; strong coding standards.
C++, Python, SQL, Machine Learning, Data Processing, Statistics
Senior Engineering Manager, Agentic & Generative AI Benchmarking and Evaluations
Santa Clara, California, United States
$201k-$352k/yrOnsiteFull Time
ServiceNowNYSE: NOW: Provides a cloud platform for automating enterprise digital workflows.
8+ YOE3+ Mgmt8+ years software/ML engineering experience with 3+ years managing AI/ML teams; expertise in LLM evaluation, benchmarking, Python, SQL, Pandas, NumPy, and ML evaluation metrics.
Python, SQL, Pandas, NumPy, ROUGE, BLEU, G-Eval, OpenAI, Anthropic, Google
AbbottNYSE: ABT: Manufactures medical devices, diagnostics, and nutritional health products.
3+ YOEBachelor's degree in electrical, electronic, or related engineering; 3+ years designing and evaluating PCBs, fixtures, and tools; experience with testing, documentation, FDA requirements, and engineering laboratory equipment.
Printed Circuit Boards (PCBs), oscilloscopes, spectrum analyzers, arbitrary waveform generators, function generators, LCR meters, power supplies, embedded systems, DSP, SPICE, Matlab, COMSOL, spreadsheet, word processing, database management
Analog DevicesNASDAQ: ADI: Designs and manufactures semiconductors for signal processing and power management.
1+ YOEMaster’s degree in Electrical Engineering and 1 year of relevant design evaluation experience; proficient in C#/C++, Python, and PCB design tools; able to automate tests and analyze results.
AI Engineer – Algorithm Evaluation & Agentic Systems
Sunnyvale, California, United States
OnsiteFull Time
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
Experience evaluating AI algorithms and designing agentic systems, with system-level reasoning, metric definition, engineering rigor, and clear technical communication.
Senior Engineering Manager, Agentic & Generative AI Benchmarking and Evaluations
Santa Clara, California, United States
$201k-$352k/yrOnsiteFull Time
ServiceNowNYSE: NOW: Enterprise cloud platform for digital workflow automation.
8+ YOE3+ MgmtRequires 8+ years of software engineering or machine learning experience, 3+ years leading AI/ML teams, Python, SQL, Pandas, NumPy, AI evaluation metrics, MLOps platforms, and a bachelor's degree in a quantitative field.
Evaluation and ML Systems Engineer, AI Safety and Security Engineering
Santa Clara or North Carolina or Tennessee or New York or California or Florida
$152k-$242k/yrHybridFull Time
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
5+ YOE5+ years ML engineering or evaluation experience, bachelor's degree or equivalent, benchmark and metrics design, Python engineering, experiment tracking, and statistical evaluation skills.
AbbottNYSE: ABT: Provides medical devices, diagnostics, and science-based nutritional products.
3+ YOEBachelor's degree in electrical, electronic, or related engineering and 3+ years of PCB, fixture, and tool construction and evaluation experience. Requires FDA compliance, testing, documentation, communication, and analytical skills.
AI Fund: Builds and invests in artificial intelligence startups.
3+ YOERequires 3+ years of software engineering experience, production LLM systems experience, strong Python and/or TypeScript/Node skills, and experience with LLM APIs, agentic workflows, evaluation, and end-to-end services.
NubankNYSE: NU: Digital financial platform offering banking, credit, and investment services.
Proven experience shipping LLM-powered systems in production; strong prompt/context engineering, evaluation and guardrail development, and software engineering skills (Python/TypeScript/Clojure).
Python, TypeScript, Clojure, n8n, Zapier, AWS, Claude Code, Cursor, Copilot, Slack, Google Workspace, Jira, Terraform, RAG, MCP
Granica: Provides an AI efficiency platform for optimizing enterprise training data.
5+ YOERequires 5+ years in sales engineering, solutions architecture, forward deployed or data engineering; expertise in data platforms, distributed systems, cloud infrastructure, SQL, and programming; enterprise evaluations and deployments experience.
Apache Spark, Apache Iceberg, Delta Lake, Trino, Presto, SQL, Large Tabular Models (LTMs)
Applied MaterialsNASDAQ: AMAT: Produces equipment and services for chip and display manufacturing.
Experienced application engineer to lead complex application activities, interface with customers, define product application plans, develop and transfer new application capabilities, and support system performance and evaluations.
Lumilens: Designs photonic interconnects for AI supercomputing infrastructure.
Senior semiconductor process engineer with hands-on III-V etch/coating experience, DOE and statistical process optimization, metrology definition (SEM, profilometry, ellipsometry), tooling evaluation, and cross-functional collaboration.
SB Energy: Develops, builds, and operates utility-scale renewable energy infrastructure.
8+ YOE8+ years BESS utility-scale engineering experience; BS in Electrical Engineering (ABET) required; MS and PE preferred; experience across EPC, commissioning, interconnection, and vendor technical evaluations.
Wayve: Develops AI software for autonomous vehicle navigation.
5+ YOE5+ years in autonomous systems, robotics, automotive, or related fields; systems engineering, sensor integration, multi-sensor evaluation, validation metrics, and cross-functional experience required.
Wayve: Develops end-to-end artificial intelligence for autonomous driving systems.
5+ YOE5+ years in autonomous systems, robotics, automotive, or related fields; systems engineering, sensor integration, multi-sensor evaluation, requirements definition, benchmarking, and cross-functional experience required.
Clera: AI talent agent matching professionals with high-growth startup roles
3+ YOERequires 3–10 years in ML research, applied ML, or ML systems engineering; PyTorch, JAX, or TensorFlow expertise; model architecture, distributed training, data processing, and evaluation experience.
KLANASDAQ: KLAC: Provides process control and yield management solutions for semiconductors.
3+ YOEPh.D./Masters/Bachelors in engineering with relevant experience; lead projects, develop and evaluate test plans, diagnose and resolve complex problems, create technical documentation, and present results.