Scotts Valley • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Scotts Valley • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Scotts Valley • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Scotts Valley • 50 milesRemote · Hybrid · Onsite · Field · All Environments
134 ai evaluation engineer jobs at 62 companies in Scotts Valley, CA
2w
Save
Mark Applied
Hide
AI Engineer – Algorithm Evaluation & Agentic Systems
Sunnyvale, California, United States
OnsiteFull Time
Experience evaluating AI algorithms and designing agentic systems, with system-level reasoning, metric definition, engineering rigor, and clear technical communication.
1mo
Save
Mark Applied
Hide
Senior Director - AI Evaluation Platform
Santa Clara, California, United States
$279k-$488k/yr HybridFull Time
Proven leadership of large AI or platform engineering teams, deep expertise in AI evaluation methodologies, production evaluation platforms, strong communication, and hands-on experience with PyTorch or TensorFlow.
PyTorch, TensorFlow
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)
McLean or San Francisco or New York City or San Jose or Cambridge
$230k-$286k/yr OnsiteFull Time
4+ YOEBachelor's plus 6 years or master's plus 4 years in AI/ML development; 6 years programming in Python, Go, Scala, or Java; experience building scalable AI systems and leading engineering teams.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
2w
Save
Mark Applied
Hide
AI Engineer
Mountain View, California, United States
OnsiteFull Time
3+ YOERequires 3+ years of software engineering experience, production LLM systems experience, strong Python and/or TypeScript/Node skills, and experience with LLM APIs, agentic workflows, evaluation, and end-to-end services.
Claude, OpenAI, Python, TypeScript, Node
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)
McLean or San Francisco or New York City or San Jose or Cambridge
$230k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years in AI/ML; 6 years programming with Python, Go, Scala, or Java; cloud AI deployment and team leadership preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, AWS, Google Cloud, Azure, C++, C#, Golang
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)
McLean or San Francisco or Cambridge or San Jose or New York City
$230k-$286k/yr OnsiteFull Time
6+ YOEBachelor's plus 6+ years (or Master's plus 4+ years) developing AI/ML systems; strong programming (Python, Go, Scala, Java); cloud AI deployment experience; leadership and research application skills.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure
3mo
Save
Mark Applied
Hide
Lead AI Engineer — Productivity Systems
Durham or Miami or Palo Alto or Washington
$12k-$18k/mo HybridFull Time
Proven experience shipping LLM-powered systems in production; strong prompt/context engineering, evaluation and guardrail development, and software engineering skills (Python/TypeScript/Clojure).
Python, TypeScript, Clojure, n8n, Zapier, AWS, Claude Code, Cursor, Copilot, Slack, Google Workspace, Jira, Terraform, RAG, MCP
1mo
Save
Mark Applied
Hide
Senior Software Engineer, AI Infrastructure - LVM Inference & Evaluation
Redwood City, California, United States
$168k-$205k/yr HybridFull Time
4+ YOE4+ years building infrastructure or production AI systems; strong Python; experience with ML infrastructure, LLM/LVM inference, inference optimization, evaluation frameworks, cloud and GPU workloads; BS/MS or equivalent.
Python, vLLM, Triton Inference Server, CUDA, NCCL, PyTorch, TensorRT, ONNX
2w
Save
Mark Applied
Hide
AI Support Engineer
San Jose or Austin
$96k-$148k/yr OnsiteFull Time
Bachelor's degree in engineering, computer science, information systems, or equivalent; experience evaluating technical solutions; AI familiarity; analytical, troubleshooting, communication, and project leadership skills.
LLMs, RAG, AI agents, MCP
3w
Save
Mark Applied
Hide
AI Harness Engineer
Barcelona or Santa Clara
OnsiteFull Time
8+ YOEFull‑stack engineering experience building LLM applications, agents, RAG, evaluation, observability, and production deployment; familiarity with MCP/A2A patterns; ability to operate under regulated constraints; typically 8+ years experience.
LLM, RAG, MCP, A2A
2mo
Save
Mark Applied
Hide
Staff AI Engineer - Conversational & Agentic AI
Santa Clara, California, United States
$176k-$308k/yr OnsiteFull Time
7+ YOERequires 7+ years building reliable production software, hands-on generative AI product experience, LLM and prompt engineering expertise, evaluation engineering, distributed systems, API design, and testing experience.
A2A, MCP, LangChain, LlamaIndex
2mo
Save
Mark Applied
Hide
Senior AI Engineer
Hyderabad or Bengaluru or San Jose
HybridFull Time
5+ YOE5+ years software engineering experience with NLP/ML, experience building LLM-powered agents, SQL and structured data experience, bachelor’s or master’s in CS/AI/ML/NLP (or related), and production-grade system and evaluation expertise.
Teradata Autonomous Knowledge Platform, LangChain, AutoGen, LLM, SQL
2mo
Save
Mark Applied
Hide
Principal AI Engineer
Santa Clara or Milpitas or Mountain View or East Foothills or Los Altos or Stanford
$176k-$293k/yr HybridFull Time
8+ YOE8+ years building and operating production-grade software with recent depth in AI/ML; proven experience shipping agentic AI systems, evaluation/experimentation frameworks, RAG/retrieval, and cloud-native tooling (Git, Docker, Kubernetes, CI/CD, AWS/Azure/GCP).
LangGraph, Google ADK, Git, Docker, Kubernetes, CI/CD, AWS, Azure, GCP
4w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
3d
Save
Mark Applied
Hide
Director, Simulation and Evaluation - Autonomous Driving
Sunnyvale, California, United States
$240k-$300k/yr HybridFull Time
10+ YOE5+ MgmtMaster’s or PhD in a quantitative field, 10+ years in software engineering, 7+ years leading ADAS/autonomous driving projects, SoP experience, and expertise in AI simulation, evaluation, and global technical leadership.
CUDA, C++, Python, Reinforcement Learning (RL), ISO 26262, SOTIF, LLMs
23h
Save
Mark Applied
Hide
Applied AI Innovation Engineer — Sales AI Applications
Santa Clara, California, United States
$124k-$196k/yr OnsiteFull Time
2+ YOEBachelor’s degree or equivalent experience encouraged; 2+ years in software, AI/ML, solutions, data engineering, or technical consulting; prototype evaluation and generative AI experience preferred.
Python, APIs
6d
Save
Mark Applied
Hide
AI Engineer
San Jose or New York City
$200k-$250k/yr HybridFull Time
3+ YOERequires 3+ years building production software, recent LLM systems experience, shipped agentic systems, retrieval and evaluation expertise, traditional ML experience, strong Python, and TypeScript proficiency.
SAP, Salesforce, Workday, Oracle, Snowflake, MuleSoft, ServiceNow, Python, TypeScript, MCP, SSO, RBAC, SOC 2
3w
Save
Mark Applied
Hide
AI Research Engineer
New York City or London or Zurich or Palo Alto or Copenhagen
$200k-$400k/yr HybridFull Time
PhD in CS, AI, or ML or equivalent research experience; publications preferred. Requires Python, ML frameworks, research systems, evaluation harnesses, data curation, reproducibility, and clear communication.
Python, PyTorch, JAX, Hugging Face, CleanRL, RLlib, AutoGen, LangGraph, CrewAI, Transformers
23h
Save
Mark Applied
Hide
Applied AI Innovation Engineer — Sales AI Applications
Santa Clara, California, United States
$124k-$196k/yr OnsiteFull Time
2+ YOEBachelor’s degree or equivalent experience encouraged; 2+ years in software, AI/ML, solutions, data engineering, or consulting. Requires prototype evaluation, generative AI, data analysis, APIs, cloud, and cross-functional communication.
generative AI, APIs, Python, AI frameworks, machine learning frameworks, retrieval-augmented generation
1mo
Save
Mark Applied
Hide
Staff ML Engineer - Embodied AI Evaluation Foundations
Sunnyvale, California, United States
$189k-$301k/yr HybridFull Time
Advanced ML engineering experience building evaluation, introspection, and visualization tools; proficiency in Python, Node.js, Spark, BigQuery, Kubernetes; BS/MS/PhD or equivalent; strong communication and production software experience.
React, TypeScript, WebGL, WebGPU, Streamlit, Jupyter Notebooks, Python, Node.js, Spark, BigQuery, Kubernetes