13 ai evaluation engineer jobs at 10 companies in Loveland, CO
2mo
Save
Mark Applied
Hide
AI Evaluation Engineer
Bucharest or Boulder or Boston or Chicago or Glendora or Richmond or London or Auckland
lei16k-lei19k/mo HybridFull Time
5+ YOEBachelor's in CS/Data/Math, 5+ years software engineering with focus on testing/evaluation or AI/ML tooling, strong Python, experience building evaluation pipelines and LLM eval concepts, familiarity with RAG and production data pipelines.
RAGAS, LangSmith, PromptFlow, Snowflake, Python, RAG
1mo
Save
Mark Applied
Hide
AI Data Analytics Engineer
Fort Collins, Colorado, United States
$102k-$147k/yr OnsiteFull Time
3+ YOE3+ years building production data or software products with analytics engineering and applied AI; proficiency in Python and SQL; experience with data warehouses, dbt, LLMs, and model evaluation.
Python, SQL, Snowflake, BigQuery, Redshift, dbt, LLM APIs, vector databases, embeddings, LangChain, LangGraph, Retrieval-Augmented Generation (RAG)
2w
Save
Mark Applied
Hide
Agentic AI Engineer
Denver, Colorado, United States
$95k-$135k/yr HybridFull Time
1.5+ YOEProduction agentic AI systems, strong Python, RAG pipelines, vector databases, LLM evaluation, agent frameworks, LLM fundamentals, and cloud platform experience; GCP preferred.
Python, GCP, AWS, Azure, Neo4j, LangChain, LangGraph, CrewAI, AutoGen, Google Agent Development Kit (ADK), Vertex AI Agent Builder, Model Context Protocol (MCP), JanusGraph, LangSmith, Langfuse, RAG
2w
Save
Mark Applied
Hide
Staff AI Platform Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York or Seattle or Toronto or Santa Barbara or San Diego
$180k-$273k/yr RemoteFull Time
7+ YOERequires 7+ years in AI/ML platform engineering, strong Python and/or TypeScript, distributed systems, APIs, evaluation, observability, and AI infrastructure experience; bachelor's degree or equivalent practical experience.
Python, TypeScript, JavaScript, React, Kubernetes, Docker, Terraform, LangChain, LangGraph, LlamaIndex, LiveKit, REST, gRPC, MCP, A2A
1mo
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
3mo
Save
Mark Applied
Hide
AI Tools Architect / Tech Lead
Spring or Fort Collins
$152k-$349k/yr HybridFull Time
10+ YOE10+ years software engineering; hands-on AI coding tools; technical leadership; CI/CD familiarity; strong communication; adaptable; AI model evaluation knowledge.
GitHub Copilot, ChatGPT, Claude, Python, CI/CD
5d
Save
Mark Applied
Hide
AI Business Partner
Denver, Colorado, United States
$110k-$200k/yr HybridFull Time
Requires hands-on low-code AI solution development, business analysis, GenAI and prompt engineering, stakeholder management, change adoption, documentation, and evaluation of emerging AI tools.
Microsoft Copilot Studio, Microsoft Power Automate, Microsoft Power Apps, Microsoft 365, Claude Desktop, SharePoint, Microsoft Teams, Dataverse, Azure AI services
2d
Save
Mark Applied
Hide
AI Business Partner
Denver, Colorado, United States
$110k-$200k/yr HybridFull Time
Hands-on Copilot Studio or Power Platform solution development, AI/GenAI tool evaluation, business analysis, stakeholder management, change adoption, prompt engineering, documentation, and AI application design experience.
Microsoft Copilot Studio, Power Platform, Power Automate, Power Apps, Claude, Microsoft 365, Microsoft SharePoint, Microsoft Teams, Dataverse, Azure AI services
3mo
Save
Mark Applied
Hide
Senior Applied AI Solutions Architect — Amazon Connect, Applied AI SA - AIVT
Seattle or Arlington or Atlanta or New York or Denver or Herndon or Chicago or Mountain View or San Francisco
$154k-$239k/yr OnsiteFull Time
7+ YOE7+ years in technology domains; 3+ years in design/implementation; familiarity with MCP/A2A; AI/ML concepts incl. LLMs, prompt engineering, RAG, model evaluation
Python, Node.js, AWS Lambda, API Gateway, Step Functions, Bedrock, MCP, RAG, DynamoDB, RDS, S3, OpenSearch, Kendra
4d
Save
Mark Applied
Hide
Senior AI Applied Manager
San Francisco or Chicago or Denver or Los Angeles or Phoenix
$125k-$186k/yr OnsiteFull Time
8+ YOERequires 8+ years of software engineering experience, expert Python, strong AWS and data skills, LLM evaluation and agentic systems experience, communication ability, and a bachelor's degree in computer science or engineering.
Python, AWS, SQL, Dataiku (DSS), OpenAI AgentKit, ChatKit, Apps SDK/MCP
2d
Save
Mark Applied
Hide
Deployed Engineer, Professional Services
Atlanta or Austin or Dallas or Las Vegas or Nashville or Seattle or Cambridge or Detroit or San Diego or Denver
$150k-$215k/yr RemoteFull Time
4+ YOERequires 4+ years of software engineering experience, deep Python expertise, 2+ years building production agent systems, client-facing communication skills, and experience with agent frameworks and AI evaluation.
Python, TypeScript, JavaScript, LangChain, LangGraph, Deep Agents, Axolotl, Unsloth, Hugging Face transformers, TRL, SFT, DPO, RLHF
2w
Save
Mark Applied
Hide
Senior Product Manager, AI & Data Science Products
Seattle or Richmond or Austin or North Charleston or Philadelphia or San Francisco or Denver or Miami or Atlanta or Chicago or Augusta or Boston or Las Vegas or Trenton or New York or Raleigh or Portland
RemoteFull Time
3+ YOERequires 3+ years of product management or comparable experience, customer-facing AI or data product ownership, applied AI/ML knowledge, data science and engineering collaboration, experimentation, analytics, and quality evaluation skills.
AI, machine learning, APIs, MCP
2mo
Save
Mark Applied
Hide
Content Automation and GenAI - Consulting and Delivery Manager
New York City or Milwaukee or Herndon or Dallas or Columbus or Kirkland or Irvine or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or Arlington or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or San Francisco or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$266k/yr OnsiteFull Time
7+ YOE7+ years client-facing consulting or digital transformation experience; hands-on experience evaluating/applying content automation or GenAI tools and delivering GenAI POCs; strong understanding of LLM concepts, prompt engineering, safety/responsible AI, content operations, and team leadership.
OpenAI, Google Gemini, M365 Copilot, Writer, FireFly, ChatGPT, Adobe Workfront, AEM, CMS, DAM, PIM