10 ai evaluation engineer jobs at 8 companies in San Diego, CA
2mo
Save
Mark Applied
Hide
AI Engineer
San Diego, California, United States
$150k-$225k/yr OnsiteFull Time
2+ YOEBachelor's degree or equivalent practical experience, 2+ years of software engineering experience, applied AI experience, Python or Java, AWS, retrieval systems, AI orchestration, evaluation, and strong communication skills.
Python, Java, AWS, OpenSearch, Pinecone, Weaviate, Redis, pgvector, Azure AI Search, LangChain, LangGraph, LlamaIndex, Semantic Kernel, OpenAI Agents SDK, N8N, AWS Bedrock Agents, AWS Bedrock Knowledge Bases, LangSmith, Arize Phoenix, OpenTelemetry, Datadog, Splunk, New Relic, CloudWatch, Model Context Protocol (MCP)
2w
Save
Mark Applied
Hide
Staff AI Platform Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York or Seattle or Toronto or Santa Barbara or San Diego
$180k-$273k/yr RemoteFull Time
7+ YOERequires 7+ years in AI/ML platform engineering, strong Python and/or TypeScript, distributed systems, APIs, evaluation, observability, and AI infrastructure experience; bachelor's degree or equivalent practical experience.
Python, TypeScript, JavaScript, React, Kubernetes, Docker, Terraform, LangChain, LangGraph, LlamaIndex, LiveKit, REST, gRPC, MCP, A2A
1mo
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
1w
Save
Mark Applied
Hide
Applied AI Engineer
San Francisco or Los Angeles or Washington or San Diego or Seattle or London
$150k-$170k/yr HybridFull Time
2+ YOEBachelor's or master's degree in a technical field, 2+ years of software development, strong Python, production systems, AI/ML integration, model evaluation, and familiarity with APIs, distributed systems, containers, CI/CD, observability, and edge deployment.
Python, APIs, CI/CD, GPU
1mo
Save
Mark Applied
Hide
Lead AI/ML Engineer (GenAI & Agentic Systems)-iCloud
San Diego, California, United States
OnsiteFull Time
Technical leadership in GenAI/agentic systems for large-scale cloud infrastructure; experience with LLMs, RAG, automation, evaluation/orchestration frameworks, and cross-team collaboration.
LLM, Retrieval-assisted generation (RAG)
3w
Save
Mark Applied
Hide
Agentic AI Engineer (Xora Portfolio Company)
San Diego or Singapore
HybridFull Time
5+ YOEBachelor's or Master's in CS/engineering,5+ years building production software with deep experience in LLM/agent systems, strong Python and engineering practices, retrieval and evaluation experience.
Python, LangGraph, AutoGen, Temporal, MLflow, Langfuse
1mo
Save
Mark Applied
Hide
Machine Learning Engineer - Generative AI
San Diego, California, United States
$104k-$156k/yr OnsiteFull Time
Design, develop, and deploy generative AI solutions including LLM fine-tuning, RAG, evaluation frameworks, agentic workflows; Bachelor's in related field required.
LangChain, LlamaIndex, Transformers, Python, PyTorch, TensorFlow, AWS, GCP, Azure
2w
Save
Mark Applied
Hide
Software Engineer, Applied AI
San Francisco or Los Angeles or Washington or San Diego or Seattle or London
$150k-$170k/yr HybridFull Time
2+ YOEBS/MS in a technical field, 2+ years of software development, strong Python, production systems, AI/ML integration, model evaluation, and familiarity with APIs, distributed systems, containers, CI/CD, observability, and edge deployment.
Python, APIs, CI/CD, GPU
2d
Save
Mark Applied
Hide
Deployed Engineer, Professional Services
Atlanta or Austin or Dallas or Las Vegas or Nashville or Seattle or Cambridge or Detroit or San Diego or Denver
$150k-$215k/yr RemoteFull Time
4+ YOERequires 4+ years of software engineering experience, deep Python expertise, 2+ years building production agent systems, client-facing communication skills, and experience with agent frameworks and AI evaluation.
Python, TypeScript, JavaScript, LangChain, LangGraph, Deep Agents, Axolotl, Unsloth, Hugging Face transformers, TRL, SFT, DPO, RLHF
2mo
Save
Mark Applied
Hide
Content Automation and GenAI - Consulting and Delivery Manager
New York City or Milwaukee or Herndon or Dallas or Columbus or Kirkland or Irvine or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or Arlington or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or San Francisco or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$266k/yr OnsiteFull Time
7+ YOE7+ years client-facing consulting or digital transformation experience; hands-on experience evaluating/applying content automation or GenAI tools and delivering GenAI POCs; strong understanding of LLM concepts, prompt engineering, safety/responsible AI, content operations, and team leadership.
OpenAI, Google Gemini, M365 Copilot, Writer, FireFly, ChatGPT, Adobe Workfront, AEM, CMS, DAM, PIM