78 ai evaluation engineer jobs at 29 companies in Hollister, CA
2w
Save
Mark Applied
Hide
AI Engineer – Algorithm Evaluation & Agentic Systems
Sunnyvale, California, United States
OnsiteFull Time
Experience evaluating AI algorithms and designing agentic systems, with system-level reasoning, metric definition, engineering rigor, and clear technical communication.
1mo
Save
Mark Applied
Hide
Senior Director - AI Evaluation Platform
Santa Clara, California, United States
$279k-$488k/yr HybridFull Time
Proven leadership of large AI or platform engineering teams, deep expertise in AI evaluation methodologies, production evaluation platforms, strong communication, and hands-on experience with PyTorch or TensorFlow.
PyTorch, TensorFlow
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)
McLean or San Francisco or New York City or San Jose or Cambridge
$230k-$286k/yr OnsiteFull Time
4+ YOEBachelor's plus 6 years or master's plus 4 years in AI/ML development; 6 years programming in Python, Go, Scala, or Java; experience building scalable AI systems and leading engineering teams.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)
McLean or San Francisco or New York City or San Jose or Cambridge
$230k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years in AI/ML; 6 years programming with Python, Go, Scala, or Java; cloud AI deployment and team leadership preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, AWS, Google Cloud, Azure, C++, C#, Golang
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)
McLean or San Francisco or Cambridge or San Jose or New York City
$230k-$286k/yr OnsiteFull Time
6+ YOEBachelor's plus 6+ years (or Master's plus 4+ years) developing AI/ML systems; strong programming (Python, Go, Scala, Java); cloud AI deployment experience; leadership and research application skills.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure
3w
Save
Mark Applied
Hide
AI Harness Engineer
Barcelona or Santa Clara
OnsiteFull Time
8+ YOEFull‑stack engineering experience building LLM applications, agents, RAG, evaluation, observability, and production deployment; familiarity with MCP/A2A patterns; ability to operate under regulated constraints; typically 8+ years experience.
LLM, RAG, MCP, A2A
2mo
Save
Mark Applied
Hide
Staff AI Engineer - Conversational & Agentic AI
Santa Clara, California, United States
$176k-$308k/yr OnsiteFull Time
7+ YOERequires 7+ years building reliable production software, hands-on generative AI product experience, LLM and prompt engineering expertise, evaluation engineering, distributed systems, API design, and testing experience.
A2A, MCP, LangChain, LlamaIndex
2mo
Save
Mark Applied
Hide
Senior AI Engineer
Hyderabad or Bengaluru or San Jose
HybridFull Time
5+ YOE5+ years software engineering experience with NLP/ML, experience building LLM-powered agents, SQL and structured data experience, bachelor’s or master’s in CS/AI/ML/NLP (or related), and production-grade system and evaluation expertise.
Teradata Autonomous Knowledge Platform, LangChain, AutoGen, LLM, SQL
2mo
Save
Mark Applied
Hide
Principal AI Engineer
Santa Clara or Milpitas or Mountain View or East Foothills or Los Altos or Stanford
$176k-$293k/yr HybridFull Time
8+ YOE8+ years building and operating production-grade software with recent depth in AI/ML; proven experience shipping agentic AI systems, evaluation/experimentation frameworks, RAG/retrieval, and cloud-native tooling (Git, Docker, Kubernetes, CI/CD, AWS/Azure/GCP).
LangGraph, Google ADK, Git, Docker, Kubernetes, CI/CD, AWS, Azure, GCP
3d
Save
Mark Applied
Hide
Director, Simulation and Evaluation - Autonomous Driving
Sunnyvale, California, United States
$240k-$300k/yr HybridFull Time
10+ YOE5+ MgmtMaster’s or PhD in a quantitative field, 10+ years in software engineering, 7+ years leading ADAS/autonomous driving projects, SoP experience, and expertise in AI simulation, evaluation, and global technical leadership.
CUDA, C++, Python, Reinforcement Learning (RL), ISO 26262, SOTIF, LLMs
5d
Save
Mark Applied
Hide
AI Engineer
San Jose or New York City
$200k-$250k/yr HybridFull Time
3+ YOERequires 3+ years building production software, recent LLM systems experience, shipped agentic systems, retrieval and evaluation expertise, traditional ML experience, strong Python, and TypeScript proficiency.
SAP, Salesforce, Workday, Oracle, Snowflake, MuleSoft, ServiceNow, Python, TypeScript, MCP, SSO, RBAC, SOC 2
1mo
Save
Mark Applied
Hide
Staff ML Engineer - Embodied AI Evaluation Foundations
Sunnyvale, California, United States
$189k-$301k/yr HybridFull Time
Advanced ML engineering experience building evaluation, introspection, and visualization tools; proficiency in Python, Node.js, Spark, BigQuery, Kubernetes; BS/MS/PhD or equivalent; strong communication and production software experience.
React, TypeScript, WebGL, WebGPU, Streamlit, Jupyter Notebooks, Python, Node.js, Spark, BigQuery, Kubernetes
3mo
Save
Mark Applied
Hide
Principal AI Research Engineer
San Jose, California, United States
$270k-$340k/yr OnsiteFull Time
MS or PhD in CS or CE; deep ML/AI expertise with transformers and foundation models; strong software practices; experience prototyping and evaluating research to production.
PyTorch, TensorFlow
1mo
Save
Mark Applied
Hide
Senior AI Engineer - Fury Team
United States or Sunnyvale
$200k-$400k/yr RemoteFull Time
6+ YOE6+ years building and deploying AI models, 2+ years with multimodal or agentic systems; proficiency in Python and PyTorch; experience with large-scale model training, evaluation, RL, and data curation; US Person required.
Python, PyTorch
3mo
Save
Mark Applied
Hide
AI Engineer, Model Quality and Performance
Sunnyvale, California, United States
OnsiteFull Time
Experience building AI agents, strong math/statistics background, familiarity with Docker, Git, CI and automation stacks, plus tooling design and model evaluation/benchmarking experience.
Claude, Docker, Git, CI, EvalScope, lm-eval-harness
6d
Save
Mark Applied
Hide
AI Architect
Bangalore or Milpitas or Seattle or Princeton or Cape Town or London or Zurich or Singapore or Mexico City
RemoteFull Time
17+ YOERequires 17–21 years of technology experience with substantial quality engineering and test engineering expertise, agentic AI architecture, evaluation-driven development, client presentations, presales, and AI assurance standards knowledge.
ZenseAI.QI, ZenseAI.AssureAI, DeepSpeci, CaseGeni, Auto-PlayPilot, DataGeni, Secure-Xi, Perf-Xi, Insights360, RIA, Agentic Foundry, LLM-as-judge, RFP, RFI, EU AI Act, NIST AI RMF, ISO/IEC 42001
2mo
Save
Mark Applied
Hide
Applied AI Engineer
Santa Clara, California, United States
HybridFull Time
Strong Python and applied ML skills with PyTorch/Hugging Face; experience building agent systems, evaluation/benchmarking frameworks, experiments, and productionizing research for clinical settings.
Python, PyTorch, Hugging Face, EHR
2w
Save
Mark Applied
Hide
Builder - Senior Software Engineer, AI
Santa Clara, California, United States
OnsiteFull Time
5+ YOE5+ years of software engineering experience focused on AI/ML systems, with expertise in LLMs, RAG, AI frameworks, model deployment, monitoring, prompt engineering, evaluation, vector databases, and semantic search.
RAG, large language models, AI/ML, ML operations, vector databases, embedding systems, semantic search
1w
Save
Mark Applied
Hide
Senior Agentic AI Software Engineer
Santa Clara or California
$152k-$288k/yr HybridFull Time
5+ YOEMS in computer science or related field or equivalent experience, 5 years of software development, strong AI agent-building experience, agent evaluation familiarity, and coding agent experience.
Codex, Claude Code
2mo
Save
Mark Applied
Hide
Principal Developer, AI Networking
Santa Clara or Texas or Colorado or Washington
$272k-$489k/yr OnsiteFull Time
15+ YOEBSc in CS or equivalent; 15+ years in high-performance networking (RDMA, MPI, NCCL, SHARP); experience with CUDA, PyTorch/TensorFlow; proficiency in Python, Bash, C++; performance evaluation and container environments.
RDMA, MPI, NCCL, SHARP, CUDA, TensorFlow, PyTorch, Python, Bash, C++