13 ai evaluation engineer jobs at 11 companies in Oceanside, CA
2mo
Save
Mark Applied
Hide
AI Engineer
San Diego, California, United States
$150k-$225k/yr OnsiteFull Time
2+ YOEBachelor's degree or equivalent practical experience, 2+ years of software engineering experience, applied AI experience, Python or Java, AWS, retrieval systems, AI orchestration, evaluation, and strong communication skills.
Python, Java, AWS, OpenSearch, Pinecone, Weaviate, Redis, pgvector, Azure AI Search, LangChain, LangGraph, LlamaIndex, Semantic Kernel, OpenAI Agents SDK, N8N, AWS Bedrock Agents, AWS Bedrock Knowledge Bases, LangSmith, Arize Phoenix, OpenTelemetry, Datadog, Splunk, New Relic, CloudWatch, Model Context Protocol (MCP)
2w
Save
Mark Applied
Hide
Staff AI Platform Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York or Seattle or Toronto or Santa Barbara or San Diego
$180k-$273k/yr RemoteFull Time
7+ YOERequires 7+ years in AI/ML platform engineering, strong Python and/or TypeScript, distributed systems, APIs, evaluation, observability, and AI infrastructure experience; bachelor's degree or equivalent practical experience.
Python, TypeScript, JavaScript, React, Kubernetes, Docker, Terraform, LangChain, LangGraph, LlamaIndex, LiveKit, REST, gRPC, MCP, A2A
4w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
1w
Save
Mark Applied
Hide
Applied AI Engineer
San Francisco or Los Angeles or Washington or San Diego or Seattle or London
$150k-$170k/yr HybridFull Time
2+ YOEBachelor's or master's degree in a technical field, 2+ years of software development, strong Python, production systems, AI/ML integration, model evaluation, and familiarity with APIs, distributed systems, containers, CI/CD, observability, and edge deployment.
Python, APIs, CI/CD, GPU
1mo
Save
Mark Applied
Hide
Lead AI/ML Engineer (GenAI & Agentic Systems)-iCloud
San Diego, California, United States
OnsiteFull Time
Technical leadership in GenAI/agentic systems for large-scale cloud infrastructure; experience with LLMs, RAG, automation, evaluation/orchestration frameworks, and cross-team collaboration.
LLM, Retrieval-assisted generation (RAG)
1mo
Save
Mark Applied
Hide
Machine Learning Engineer - Generative AI
San Diego, California, United States
$104k-$156k/yr OnsiteFull Time
Design, develop, and deploy generative AI solutions including LLM fine-tuning, RAG, evaluation frameworks, agentic workflows; Bachelor's in related field required.
LangChain, LlamaIndex, Transformers, Python, PyTorch, TensorFlow, AWS, GCP, Azure
3w
Save
Mark Applied
Hide
Agentic AI Engineer (Xora Portfolio Company)
San Diego or Singapore
HybridFull Time
5+ YOEBachelor's or Master's in CS/engineering,5+ years building production software with deep experience in LLM/agent systems, strong Python and engineering practices, retrieval and evaluation experience.
Python, LangGraph, AutoGen, Temporal, MLflow, Langfuse
4w
Save
Mark Applied
Hide
Senior AI/ML Engineer - Agentic AI
Newport Beach, California, United States
$131k-$272k/yr HybridFull Time
6+ YOEBS/MS/PhD in CS or related field; 6+ years shipping ML systems with 3+ years hands-on LLM/agent production experience; expert Python, PyTorch, inference optimization, agent frameworks, evaluation and observability.
Python, PyTorch, LoRA, QLoRA, PEFT, vLLM, TensorRT-LLM, int8, int4, GPTQ, AWQ, LangGraph, LangChain, CrewAI, AutoGen, MCP, Claude Code, OpenCode, Langfuse, LangSmith, Arize, SFT, DPO, RLHF
2mo
Save
Mark Applied
Hide
Sr. AI Agent / Prompt Engineer
Irvine, California, United States
HybridFull Time
8+ YOEDesign and deploy production AI agents using LLMs, build prompt systems and tool orchestration, evaluate agent behavior, integrate with enterprise systems; strong Python and agent-framework experience required.
Python, LangChain, LangGraph
2w
Save
Mark Applied
Hide
Software Engineer, Applied AI
San Francisco or Los Angeles or Washington or San Diego or Seattle or London
$150k-$170k/yr HybridFull Time
2+ YOEBS/MS in a technical field, 2+ years of software development, strong Python, production systems, AI/ML integration, model evaluation, and familiarity with APIs, distributed systems, containers, CI/CD, observability, and edge deployment.
Python, APIs, CI/CD, GPU
2w
Save
Mark Applied
Hide
Applied LLM Systems Engineer
Costa Mesa or Santa Ana
$112k-$149k/yr OnsiteFull Time
5+ YOERequires 5+ years of software engineering, production AI delivery, Python proficiency, LLM optimization, evaluation and observability experience, and eligibility for Secret or higher US security clearance.
Python, Lattice OS, S1000D, DITA, MIL-STD-40051, CI/CD
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Legal — CoCounsel Forward Deployed Engineering
Frisco or New York City or Toronto or Ann Arbor or Eagan or San Francisco or Los Angeles or Irvine or McLean or Washington
$95k-$176k/yr HybridFull Time
5+ YOEJD or formal legal training (or equivalent experience),5+ years software engineering,proficiency in Python,AI/LLM evaluation and prompt engineering,ability to engage legal users and mentor engineers,experience delivering production-grade SaaS solutions.
Python
2mo
Save
Mark Applied
Hide
Content Automation and GenAI - Consulting and Delivery Manager
New York City or Milwaukee or Herndon or Dallas or Columbus or Kirkland or Irvine or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or Arlington or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or San Francisco or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$266k/yr OnsiteFull Time
7+ YOE7+ years client-facing consulting or digital transformation experience; hands-on experience evaluating/applying content automation or GenAI tools and delivering GenAI POCs; strong understanding of LLM concepts, prompt engineering, safety/responsible AI, content operations, and team leadership.
OpenAI, Google Gemini, M365 Copilot, Writer, FireFly, ChatGPT, Adobe Workfront, AEM, CMS, DAM, PIM