45 ai evaluation jobs at 37 companies in Los Angeles, CA
2mo
Save
Mark Applied
Hide
AI Evaluation Engineer
Bucharest or Boulder or Boston or Chicago or Glendora or Richmond or London or Auckland
lei16k-lei19k/mo HybridFull Time
5+ YOEBachelor's in CS/Data/Math, 5+ years software engineering with focus on testing/evaluation or AI/ML tooling, strong Python, experience building evaluation pipelines and LLM eval concepts, familiarity with RAG and production data pipelines.
RAGAS, LangSmith, PromptFlow, Snowflake, Python, RAG
1mo
Save
Mark Applied
Hide
Real Estate Evaluation Officer
Monterey Park, California, United States
$20-$40/hr OnsiteFull Time
Experience reviewing or evaluating commercial and residential real estate appraisals, ability to write evaluation and QC reports, market analysis, proficiency with Microsoft Word and Excel and AI tools, legal U.S. work authorization required.
Microsoft Word, Microsoft Excel, Artificial Intelligence (AI)
1mo
Save
Mark Applied
Hide
AI Engineer, Agents and Evaluation
Torrance, California, United States
OnsiteFull Time
Proven production experience shipping agent or tool-use systems, experience self-hosting open-weights models on GPUs, strong orchestration/serving/evaluation skills, and habit of treating hallucination as engineering problem.
vLLM, TGI
2w
Save
Mark Applied
Hide
AI Research Scientist, Learning & Evaluation
Beverly Hills, California, United States
$180k-$280k/yr OnsiteFull Time
5+ YOEPhD or equivalent with 5+ years applying quantitative methods to products, experience evaluating LLMs, experimental design, causal inference, strong communication and analytics skills.
Python, Pandas, NumPy, SciPy, Jupyter, SQL, MongoDB, PostgreSQL, GCP
1mo
Save
Mark Applied
Hide
AI Engineering Lead
Los Angeles, California, United States
$225k-$250k/yr HybridFull Time
8+ YOE8+ years software engineering experience, strong Python skills, experience leading enterprise AI initiatives, LLM fundamentals, AWS Bedrock, Anthropic Claude, multi-agent frameworks, model evaluation, governance, and stakeholder influence.
Python, AWS Bedrock, Anthropic Claude, Claude Code, Langfuse, LangGraph, LangChain, MCP, Snowflake, Oracle
6d
Save
Mark Applied
Hide
Staff AI Platform Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York or Seattle or Toronto or Santa Barbara or San Diego
$180k-$273k/yr RemoteFull Time
7+ YOERequires 7+ years in AI/ML platform engineering, strong Python and/or TypeScript, distributed systems, APIs, evaluation, observability, and AI infrastructure experience; bachelor's degree or equivalent practical experience.
Python, TypeScript, JavaScript, React, Kubernetes, Docker, Terraform, LangChain, LangGraph, LlamaIndex, LiveKit, REST, gRPC, MCP, A2A
2w
Save
Mark Applied
Hide
AI/VFX R&D Lead, AI Studios, Amazon MGM Studios
Culver City, California, United States
$141k-$191k/yr OnsiteFull Time
8+ YOE8+ years VFX production experience, hands-on AI/GenAI tools for cinematic content, experience taking workflows from R&D to production, vendor evaluation, pipeline integration, and training design.
AI/GenAI
2mo
Save
Mark Applied
Hide
Principal, Applied AI Enablement, Legal
West Hollywood, California, United States
$150k-$220k/yr OnsiteFull Time
Experienced AI/product builder to prototype, ship, and iterate AI tools for legal work; strong applied ML/AI judgment, prototyping, evaluation, and ability to partner with legal, engineering, and ops teams.
2w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
1d
Save
Mark Applied
Hide
Applied AI Engineer
San Francisco or Los Angeles or Washington or San Diego or Seattle or London
$150k-$170k/yr HybridFull Time
2+ YOEBachelor's or master's degree in a technical field, 2+ years of software development, strong Python, production systems, AI/ML integration, model evaluation, and familiarity with APIs, distributed systems, containers, CI/CD, observability, and edge deployment.
Python, APIs, CI/CD, GPU
2mo
Save
Mark Applied
Hide
Principal, Applied AI Enablement, Legal
West Hollywood, California, United States
$150k-$220k/yr HybridFull Time
4+ YOE4+ years building or applying AI products; hands-on experience with prompting, agents, RAG, evaluations, and fine-tuning; technical fluency with APIs/data/integrations; track record of shipping and cross-functional collaboration with legal teams.
APIs, Retrieval-augmented generation (RAG)
1mo
Save
Mark Applied
Hide
Senior AI Engineer
United States or New York City or Palm Beach or Los Angeles or Miami or Greenwich or Westchester County or The Hamptons or San Francisco or Manhattan
$190k-$250k/yr RemoteFull Time
4+ YOE4+ years building and operating LLM-powered production ML systems, strong Python, backend framework experience (FastAPI/Flask), LLM orchestration and retrieval design, Snowflake/dbt/Dagster/Airflow familiarity, evaluation systems, HIPAA/PHI knowledge, and strong written communication.
Python, FastAPI, Flask, Snowflake, dbt, Dagster, Airflow, vLLM, Triton, TGI, SGLang, LOINC, SNOMED CT, ICD-10, RxNorm, FHIR, HL7
2w
Save
Mark Applied
Hide
Senior AI/ML Engineer - Agentic AI
Newport Beach, California, United States
$131k-$272k/yr HybridFull Time
6+ YOEBS/MS/PhD in CS or related field; 6+ years shipping ML systems with 3+ years hands-on LLM/agent production experience; expert Python, PyTorch, inference optimization, agent frameworks, evaluation and observability.
Python, PyTorch, LoRA, QLoRA, PEFT, vLLM, TensorRT-LLM, int8, int4, GPTQ, AWQ, LangGraph, LangChain, CrewAI, AutoGen, MCP, Claude Code, OpenCode, Langfuse, LangSmith, Arize, SFT, DPO, RLHF
2mo
Save
Mark Applied
Hide
Sr. AI Agent / Prompt Engineer
Irvine, California, United States
HybridFull Time
8+ YOEDesign and deploy production AI agents using LLMs, build prompt systems and tool orchestration, evaluate agent behavior, integrate with enterprise systems; strong Python and agent-framework experience required.
Python, LangChain, LangGraph
1mo
Save
Mark Applied
Hide
ITS Manager of AI & Innovative Technologies Strategy
Los Angeles, California, United States
$115k-$155k/yr OnsiteFull Time
5+ YOEBachelor's required (master's preferred),5+ years leading technology/AI program management, experience with AI/GenAI evaluation-to-scale, governance, data practices, stakeholder engagement, and training.
LLMs, OpenAI, Anthropic, Google Gemini, Microsoft Copilot, LMS, SIS, CRM
3mo
Save
Mark Applied
Hide
AI Architect — Model Design, Training & Multi-Modal Deployment
Santa Monica, California, United States
$240k-$340k/yr OnsiteFull Time
7+ YOERequires 7+ years in ML engineering, 3+ years training or fine-tuning large models, deep PyTorch or JAX expertise, distributed training, production inference at scale, and model evaluation skills.
PyTorch, JAX, CUDA, Triton, Transformers, RLHF, vLLM, Ray, Kubernetes, FSDP, DeepSpeed, TPU
1w
Save
Mark Applied
Hide
AI Safety Evaluation & Governance Product Manager Intern (TikTok-Platform Responsibility-Feed Safety) - 2027 Summer
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
OnsiteInternship
Currently pursuing an undergraduate or master's degree in a quantitative field; knowledge of applied statistics and AI/ML concepts; strong structured thinking; English and Chinese communication skills.
AI/ML, NLP, LLMs
1mo
Save
Mark Applied
Hide
AI Agent Researcher
San Francisco or Los Angeles
$160k-$320k/yr OnsiteFull Time
Deep systems and ML expertise, published AI research, strong architecture and coding skills, proficiency with Python/C++/Cuda and LLMs/ANNs, ability to prototype and evaluate state-of-the-art models.
Python, Engrish, LLMs, ANNs, C++/Cuda
1w
Save
Mark Applied
Hide
Vice President, Enterprise AI Office
Pleasanton or Eureka or Sacramento or Stockton or Fresno or Bakersfield or Glendale or Pasadena or San Diego or Orange County or Los Angeles or Vacaville or San Francisco
HybridFull Time
Enterprise AI leadership experience spanning strategy, governance, use-case evaluation, change management, vendor relations, talent development, AI workflows, privacy, compliance, and ethical adoption.
ChatGPT
2w
Save
Mark Applied
Hide
Application Software Engineer, Applied AI
Bastrop or Cape Canaveral or Hawthorne or McGregor or Redmond or Brownsville or Vandenberg
OnsiteFull Time
1+ YOEDesign, evaluate, deploy, and integrate AI systems; 1+ years full-stack development; bachelor's in CS/engineering/math or 2+ years experience acceptable; experience shipping production AI preferred.
Python, C#.NET, Go, Scala, Java, Docker, Kubernetes, Kafka, Angular, React, PostgreSQL, SQL Server
Explore Jobs
Expand Your Job Search
Top Cities Near Los Angeles for AI Evaluation
- AI Evaluation jobs in Long Beach, CA
- AI Evaluation jobs in Anaheim, CA
- AI Evaluation jobs in Santa Ana, CA
- AI Evaluation jobs in Riverside, CA
- AI Evaluation jobs in Irvine, CA
- AI Evaluation jobs in Fontana, CA
- AI Evaluation jobs in Huntington Beach, CA
- AI Evaluation jobs in Glendale, CA
- AI Evaluation jobs in Santa Clarita, CA
- AI Evaluation jobs in Garden Grove, CA
- AI Evaluation jobs in Rancho Cucamonga, CA
- AI Evaluation jobs in Ontario, CA
- AI Evaluation jobs in Corona, CA
- AI Evaluation jobs in Lancaster, CA
- AI Evaluation jobs in Palmdale, CA
- AI Evaluation jobs in Pomona, CA
- AI Evaluation jobs in Torrance, CA
- AI Evaluation jobs in Pasadena, CA
- AI Evaluation jobs in Orange, CA
- AI Evaluation jobs in Fullerton, CA