15 ai evaluation engineer jobs at 14 companies in Riverside, CA
2mo
Save
Mark Applied
Hide
AI Evaluation Engineer
Bucharest or Boulder or Boston or Chicago or Glendora or Richmond or London or Auckland
lei16k-lei19k/mo HybridFull Time
5+ YOEBachelor's in CS/Data/Math, 5+ years software engineering with focus on testing/evaluation or AI/ML tooling, strong Python, experience building evaluation pipelines and LLM eval concepts, familiarity with RAG and production data pipelines.
RAGAS, LangSmith, PromptFlow, Snowflake, Python, RAG
2w
Save
Mark Applied
Hide
Staff AI Platform Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York or Seattle or Toronto or Santa Barbara or San Diego
$180k-$273k/yr RemoteFull Time
7+ YOERequires 7+ years in AI/ML platform engineering, strong Python and/or TypeScript, distributed systems, APIs, evaluation, observability, and AI infrastructure experience; bachelor's degree or equivalent practical experience.
Python, TypeScript, JavaScript, React, Kubernetes, Docker, Terraform, LangChain, LangGraph, LlamaIndex, LiveKit, REST, gRPC, MCP, A2A
1w
Save
Mark Applied
Hide
Applied AI Engineer
San Francisco or Los Angeles or Washington or San Diego or Seattle or London
$150k-$170k/yr HybridFull Time
2+ YOEBachelor's or master's degree in a technical field, 2+ years of software development, strong Python, production systems, AI/ML integration, model evaluation, and familiarity with APIs, distributed systems, containers, CI/CD, observability, and edge deployment.
Python, APIs, CI/CD, GPU
2mo
Save
Mark Applied
Hide
Senior AI Engineer
United States or New York City or Palm Beach or Los Angeles or Miami or Greenwich or Westchester County or The Hamptons or San Francisco or Manhattan
$190k-$250k/yr RemoteFull Time
4+ YOE4+ years building and operating LLM-powered production ML systems, strong Python, backend framework experience (FastAPI/Flask), LLM orchestration and retrieval design, Snowflake/dbt/Dagster/Airflow familiarity, evaluation systems, HIPAA/PHI knowledge, and strong written communication.
Python, FastAPI, Flask, Snowflake, dbt, Dagster, Airflow, vLLM, Triton, TGI, SGLang, LOINC, SNOMED CT, ICD-10, RxNorm, FHIR, HL7
2mo
Save
Mark Applied
Hide
AI Engineering Lead
Los Angeles, California, United States
$225k-$250k/yr HybridFull Time
8+ YOE8+ years software engineering experience, strong Python skills, experience leading enterprise AI initiatives, LLM fundamentals, AWS Bedrock, Anthropic Claude, multi-agent frameworks, model evaluation, governance, and stakeholder influence.
Python, AWS Bedrock, Anthropic Claude, Claude Code, Langfuse, LangGraph, LangChain, MCP, Snowflake, Oracle
4w
Save
Mark Applied
Hide
Senior AI/ML Engineer - Agentic AI
Newport Beach, California, United States
$131k-$272k/yr HybridFull Time
6+ YOEBS/MS/PhD in CS or related field; 6+ years shipping ML systems with 3+ years hands-on LLM/agent production experience; expert Python, PyTorch, inference optimization, agent frameworks, evaluation and observability.
Python, PyTorch, LoRA, QLoRA, PEFT, vLLM, TensorRT-LLM, int8, int4, GPTQ, AWQ, LangGraph, LangChain, CrewAI, AutoGen, MCP, Claude Code, OpenCode, Langfuse, LangSmith, Arize, SFT, DPO, RLHF
2mo
Save
Mark Applied
Hide
Sr. AI Agent / Prompt Engineer
Irvine, California, United States
HybridFull Time
8+ YOEDesign and deploy production AI agents using LLMs, build prompt systems and tool orchestration, evaluate agent behavior, integrate with enterprise systems; strong Python and agent-framework experience required.
Python, LangChain, LangGraph
2w
Save
Mark Applied
Hide
Software Engineer, Applied AI
San Francisco or Los Angeles or Washington or San Diego or Seattle or London
$150k-$170k/yr HybridFull Time
2+ YOEBS/MS in a technical field, 2+ years of software development, strong Python, production systems, AI/ML integration, model evaluation, and familiarity with APIs, distributed systems, containers, CI/CD, observability, and edge deployment.
Python, APIs, CI/CD, GPU
2mo
Save
Mark Applied
Hide
Information Technology - Principal Platform Engineer, Enterprise AI Enablement
Vancouver or Seattle or Toronto or New York City or Los Angeles
OnsiteFull Time
Deep enterprise AI and platform architecture experience, LLMOps/MLOps, AI guardrails and observability, vector DBs and data orchestration, vendor evaluation, and cross-functional leadership for enterprise AI enablement.
Azure AI Studio, AWS Bedrock, Google Cloud Vertex AI, LLMOps, MLOps, RAG
2d
Save
Mark Applied
Hide
Senior Product Manager, AI Safety Evaluation & Governance - TikTok Safety Product
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$186k-$374k/yr OnsiteFull Time
5+ YOEBachelor's degree in a quantitative field and 5+ years in AI/ML evaluation, model quality, trust and safety, or data-driven product management; SQL, LLM, prompt engineering, and Chinese fluency required.
SQL, Large Language Models (LLMs)
1d
Save
Mark Applied
Hide
Senior AI Applied Manager
San Francisco or Chicago or Denver or Los Angeles or Phoenix
$125k-$186k/yr OnsiteFull Time
8+ YOERequires 8+ years of software engineering experience, expert Python, strong AWS and data skills, LLM evaluation and agentic systems experience, communication ability, and a bachelor's degree in computer science or engineering.
Python, AWS, SQL, Dataiku (DSS), OpenAI AgentKit, ChatKit, Apps SDK/MCP
2w
Save
Mark Applied
Hide
Applied LLM Systems Engineer
Costa Mesa or Santa Ana
$112k-$149k/yr OnsiteFull Time
5+ YOERequires 5+ years of software engineering, production AI delivery, Python proficiency, LLM optimization, evaluation and observability experience, and eligibility for Secret or higher US security clearance.
Python, Lattice OS, S1000D, DITA, MIL-STD-40051, CI/CD
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Legal — CoCounsel Forward Deployed Engineering
Frisco or New York City or Toronto or Ann Arbor or Eagan or San Francisco or Los Angeles or Irvine or McLean or Washington
$95k-$176k/yr HybridFull Time
5+ YOEJD or formal legal training (or equivalent experience),5+ years software engineering,proficiency in Python,AI/LLM evaluation and prompt engineering,ability to engage legal users and mentor engineers,experience delivering production-grade SaaS solutions.
Python
3mo
Save
Mark Applied
Hide
Legal Engineering Attorney
New York or Boston or Los Angeles or Chicago or Washington
$220k-$250k/yr HybridFull Time
3+ YOEJ.D. required; 3+ years substantive legal practice and 2+ years legal engineering experience. Experience authoring prompts and working with JSON/JSON Schema/YAML/Markdown and evaluating AI outputs.
JSON, JSON Schema, YAML, Markdown
2mo
Save
Mark Applied
Hide
Content Automation and GenAI - Consulting and Delivery Manager
New York City or Milwaukee or Herndon or Dallas or Columbus or Kirkland or Irvine or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or Arlington or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or San Francisco or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$266k/yr OnsiteFull Time
7+ YOE7+ years client-facing consulting or digital transformation experience; hands-on experience evaluating/applying content automation or GenAI tools and delivering GenAI POCs; strong understanding of LLM concepts, prompt engineering, safety/responsible AI, content operations, and team leadership.
OpenAI, Google Gemini, M365 Copilot, Writer, FireFly, ChatGPT, Adobe Workfront, AEM, CMS, DAM, PIM
Explore Jobs
Expand Your Job Search
Top Cities Near Riverside for AI Evaluation Engineer
- AI Evaluation Engineer jobs in Los Angeles, CA
- AI Evaluation Engineer jobs in Long Beach, CA
- AI Evaluation Engineer jobs in Anaheim, CA
- AI Evaluation Engineer jobs in Santa Ana, CA
- AI Evaluation Engineer jobs in Irvine, CA
- AI Evaluation Engineer jobs in San Bernardino, CA
- AI Evaluation Engineer jobs in Fontana, CA
- AI Evaluation Engineer jobs in Moreno Valley, CA
- AI Evaluation Engineer jobs in Huntington Beach, CA
- AI Evaluation Engineer jobs in Garden Grove, CA
- AI Evaluation Engineer jobs in Rancho Cucamonga, CA
- AI Evaluation Engineer jobs in Ontario, CA
- AI Evaluation Engineer jobs in Corona, CA
- AI Evaluation Engineer jobs in Pomona, CA
- AI Evaluation Engineer jobs in Pasadena, CA
- AI Evaluation Engineer jobs in Orange, CA
- AI Evaluation Engineer jobs in Fullerton, CA
- AI Evaluation Engineer jobs in Victorville, CA
- AI Evaluation Engineer jobs in El Monte, CA
- AI Evaluation Engineer jobs in Downey, CA