HiringCafe
Join our community

59 ai evaluation engineer jobs at 18 companies in Salinas, CA

1mo
Save
Mark Applied
Hide
Senior Director - AI Evaluation Platform
Santa Clara, California, United States
$279k-$488k/yr HybridFull Time
ServiceNow
ServiceNowNYSE: NOW: Provides a cloud platform for automating enterprise digital workflows.
Proven leadership of large AI or platform engineering teams, deep expertise in AI evaluation methodologies, production evaluation platforms, strong communication, and hands-on experience with PyTorch or TensorFlow.
PyTorch, TensorFlow
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)
McLean or San Francisco or New York City or San Jose or Cambridge
$230k-$286k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
4+ YOEBachelor's plus 6 years or master's plus 4 years in AI/ML development; 6 years programming in Python, Go, Scala, or Java; experience building scalable AI systems and leading engineering teams.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)
McLean or San Francisco or New York City or San Jose or Cambridge
$230k-$286k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years in AI/ML; 6 years programming with Python, Go, Scala, or Java; cloud AI deployment and team leadership preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, AWS, Google Cloud, Azure, C++, C#, Golang
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)
McLean or San Francisco or Cambridge or San Jose or New York City
$230k-$286k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
6+ YOEBachelor's plus 6+ years (or Master's plus 4+ years) developing AI/ML systems; strong programming (Python, Go, Scala, Java); cloud AI deployment experience; leadership and research application skills.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure
Job PostingView all
3w
Save
Mark Applied
Hide
AI Harness Engineer
Barcelona or Santa Clara
OnsiteFull Time
Agilent Technologies
Agilent TechnologiesNew York Stock Exchange: A: Providing instruments, software, and consumables for laboratory scientific discovery.
8+ YOEFull‑stack engineering experience building LLM applications, agents, RAG, evaluation, observability, and production deployment; familiarity with MCP/A2A patterns; ability to operate under regulated constraints; typically 8+ years experience.
LLM, RAG, MCP, A2A
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff AI Engineer - Conversational & Agentic AI
Santa Clara, California, United States
$176k-$308k/yr OnsiteFull Time
ServiceNow
ServiceNowNYSE: NOW: Enterprise cloud platform for digital workflow automation.
7+ YOERequires 7+ years building reliable production software, hands-on generative AI product experience, LLM and prompt engineering expertise, evaluation engineering, distributed systems, API design, and testing experience.
A2A, MCP, LangChain, LlamaIndex
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior AI Engineer
Hyderabad or Bengaluru or San Jose
HybridFull Time
Teradata
TeradataNew York Stock Exchange: TDC: Provides cloud data analytics and enterprise AI software platforms.
5+ YOE5+ years software engineering experience with NLP/ML, experience building LLM-powered agents, SQL and structured data experience, bachelor’s or master’s in CS/AI/ML/NLP (or related), and production-grade system and evaluation expertise.
Teradata Autonomous Knowledge Platform, LangChain, AutoGen, LLM, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer, AIML Evaluation
Cupertino, California, United States
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
Engineer with interest in AI/ML to develop and evaluate features for Siri and Apple Intelligence; strong software engineering skills and passion for machine learning.
Job PostingView all
2mo
Save
Mark Applied
Hide
Principal AI Engineer
Santa Clara or Milpitas or Mountain View or East Foothills or Los Altos or Stanford
$176k-$293k/yr HybridFull Time
BMC Software
BMC Software: Provides enterprise software for IT management and automation.
8+ YOE8+ years building and operating production-grade software with recent depth in AI/ML; proven experience shipping agentic AI systems, evaluation/experimentation frameworks, RAG/retrieval, and cloud-native tooling (Git, Docker, Kubernetes, CI/CD, AWS/Azure/GCP).
LangGraph, Google ADK, Git, Docker, Kubernetes, CI/CD, AWS, Azure, GCP
Job PostingView all
5d
Save
Mark Applied
Hide
AI Engineer
San Jose or New York City
$200k-$250k/yr HybridFull Time
Tessera Labs
Tessera Labs: Automates complex enterprise workflows with multi-agent AI systems.
3+ YOERequires 3+ years building production software, recent LLM systems experience, shipped agentic systems, retrieval and evaluation expertise, traditional ML experience, strong Python, and TypeScript proficiency.
SAP, Salesforce, Workday, Oracle, Snowflake, MuleSoft, ServiceNow, Python, TypeScript, MCP, SSO, RBAC, SOC 2
Job PostingView all
3mo
Save
Mark Applied
Hide
Principal AI Research Engineer
San Jose, California, United States
$270k-$340k/yr OnsiteFull Time
Archer
ArcherNYSE: ACHR: Develops electric vertical takeoff and landing aircraft for urban mobility.
MS or PhD in CS or CE; deep ML/AI expertise with transformers and foundation models; strong software practices; experience prototyping and evaluating research to production.
PyTorch, TensorFlow
Job PostingView all
2mo
Save
Mark Applied
Hide
Applied AI Engineer
Santa Clara, California, United States
HybridFull Time
Sully.ai
Sully.ai: Autonomous AI agents for hospital operations and clinical workflows.
Strong Python and applied ML skills with PyTorch/Hugging Face; experience building agent systems, evaluation/benchmarking frameworks, experiments, and productionizing research for clinical settings.
Python, PyTorch, Hugging Face, EHR
Job PostingView all
2w
Save
Mark Applied
Hide
Builder - Senior Software Engineer, AI
Santa Clara, California, United States
OnsiteFull Time
Reevo
Reevo: AI-native revenue operating system for go-to-market teams.
5+ YOE5+ years of software engineering experience focused on AI/ML systems, with expertise in LLMs, RAG, AI frameworks, model deployment, monitoring, prompt engineering, evaluation, vector databases, and semantic search.
RAG, large language models, AI/ML, ML operations, vector databases, embedding systems, semantic search
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Agentic AI Software Engineer
Santa Clara or California
$152k-$288k/yr HybridFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
5+ YOEMS in computer science or related field or equivalent experience, 5 years of software development, strong AI agent-building experience, agent evaluation familiarity, and coding agent experience.
Codex, Claude Code
Job PostingView all
2mo
Save
Mark Applied
Hide
Principal Developer, AI Networking
Santa Clara or Texas or Colorado or Washington
$272k-$489k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
15+ YOEBSc in CS or equivalent; 15+ years in high-performance networking (RDMA, MPI, NCCL, SHARP); experience with CUDA, PyTorch/TensorFlow; proficiency in Python, Bash, C++; performance evaluation and container environments.
RDMA, MPI, NCCL, SHARP, CUDA, TensorFlow, PyTorch, Python, Bash, C++
Job PostingView all
2mo
Save
Mark Applied
Hide
Head of AI Products
Santa Clara, California, United States
$250k-$300k/yr HybridFull Time
LeanData
LeanData: Automates lead-to-account matching and routing for B2B revenue teams.
4+ YOE3+ Mgmt4+ years building/shipping ML or AI/LLM systems (production), including 3+ years managing engineers; strong Python; applied AI/LLM product experience; evaluation and quality measurement for non-deterministic systems; ability to drive 0-to-1 features.
Python, Promptfoo, Braintrust, Langfuse, Inngest, Temporal, Salesforce, LLM
Job PostingView all
1mo
Save
Mark Applied
Hide
Applied AI Engineer, Kernel Performance
San Jose, California, United States
$150k-$225k/yr OnsiteFull Time
Etched
Etched: Designs specialized AI chips optimized for transformer architectures.
Experience building systems that convert model architectures into optimized kernels; strong Python and low-level coding skills; kernel and accelerator performance knowledge; experience with LLM-based agents and experiment-driven evaluation.
Python, LLM
Job PostingView all
1mo
Save
Mark Applied
Hide
AI Vision Research Engineer - PICO - San Jose
San Jose, California, United States
OnsiteFull Time
ByteDance
ByteDance: Developing AI-driven content platforms and mobile applications.
3+ YOEPhD in EE/CS/Physics or related, 3+ years research in ML algorithms or AI accelerator design, proficiency in C/C++, MATLAB, Python, and experience with FPGA prototyping and system evaluation.
C/C++, MATLAB, Python, FPGA
Job PostingView all
6d
Save
Mark Applied
Hide
ML and AI Knowledge Systems Engineer
San Jose, California, United States
$210k-$360k/yr HybridFull Time
AMD
AMDNASDAQ: AMD: Designs and manufactures computer processors and graphics technology.
Deep production ML, search, ranking, or information-retrieval experience; RAG, embeddings, evaluation, distributed inference, and GPU optimization expertise; architecture leadership and mentoring; master's or doctoral degree preferred.
RTL, Confluence, JIRA, RAG, Model Context Protocol (MCP), vLLM, AMD Instinct GPUs, EDA, NLP
Job PostingView all
2d
Save
Mark Applied
Hide
Senior Product Manager, AI Safety Evaluation & Governance - TikTok Safety Product
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$186k-$374k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
5+ YOEBachelor's degree in a quantitative field and 5+ years in AI/ML evaluation, model quality, trust and safety, or data-driven product management; SQL, LLM, prompt engineering, and Chinese fluency required.
SQL, Large Language Models (LLMs)
Job PostingView all

Explore Jobs

Expand Your Job Search