23 ai evaluation engineer jobs at 20 companies in Kenosha, WI
2mo
Save
Mark Applied
Hide
AI Evaluation Engineer
Bucharest or Boulder or Boston or Chicago or Glendora or Richmond or London or Auckland
lei16k-lei19k/mo HybridFull Time
5+ YOEBachelor's in CS/Data/Math, 5+ years software engineering with focus on testing/evaluation or AI/ML tooling, strong Python, experience building evaluation pipelines and LLM eval concepts, familiarity with RAG and production data pipelines.
RAGAS, LangSmith, PromptFlow, Snowflake, Python, RAG
3mo
Save
Mark Applied
Hide
AI Engineer
Plano or Purchase or Chicago
$94k-$156k/yr OnsiteFull Time
6+ YOEBachelor in CS/AI/ML or equivalent; 6-8 years software lifecycle; ML/LLM/agent systems; Python/Java; production-grade AI delivery; strong evaluation and automation.
Python, Java, FastAPI, asyncio, Pydantic, LangChain, LangGraph, CrewAI, MLflow, Arise, Docker, Kubernetes, Ray, Kafka, gRPC, Redis, Prometheus, OpenTelemetry, Grafana
1d
Save
Mark Applied
Hide
AI Engineer- Virtual
Deerfield, Illinois, United States
$120k-$220k/yr RemoteFull Time
Requires Python 3.10+, AWS, Git/GitHub, software engineering, security awareness, and expertise in AI agents, retrieval, evaluation, infrastructure, observability, or developer experience.
Python, AWS, IAM, ECS, Fargate, Git, GitHub, LangGraph, DeepEval, Ragas, Terraform, OpenTelemetry, MCP, Docker, CLI, SDK
2w
Save
Mark Applied
Hide
Staff AI Platform Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York or Seattle or Toronto or Santa Barbara or San Diego
$180k-$273k/yr RemoteFull Time
7+ YOERequires 7+ years in AI/ML platform engineering, strong Python and/or TypeScript, distributed systems, APIs, evaluation, observability, and AI infrastructure experience; bachelor's degree or equivalent practical experience.
Python, TypeScript, JavaScript, React, Kubernetes, Docker, Terraform, LangChain, LangGraph, LlamaIndex, LiveKit, REST, gRPC, MCP, A2A
3w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
1mo
Save
Mark Applied
Hide
Senior AI Engineer
Chicago or Hong Kong or London or New York City or Singapore
$200k-$300k/yr OnsiteFull Time
5+ YOE5+ years software engineering with strong Python; production fine-tuning/distillation of open-weight models; on-prem LLM serving, GPU infrastructure and Kubernetes experience; model evaluation and tooling.
Python, Llama, Qwen, Mistral, vLLM, TGI, Triton, Kubernetes, Hugging Face
1d
Save
Mark Applied
Hide
Oliver Wyman - Senior Lead Engineer
New York City or Boston or Washington or Chicago
$195k-$250k/yr HybridFull Time
Requires a quantitative or computational science background, large-scale production AI systems experience, modern AI programming fluency, agent platform knowledge, LLM design expertise, AI evaluation and governance skills, and strong mathematical grounding.
Azure Foundry, AWS Bedrock, Gemini Enterprise Agent Platform, Open-Source
1d
Save
Mark Applied
Hide
Remote Software Developer – AI Research & Evaluation
United States or Chicago or San Francisco
$200-$300/hr RemoteMultiple Commitments Available
3+ YOERequires 3+ years of software engineering experience, systems, infrastructure, or backend expertise, scalable production software experience, strong architecture and debugging skills, and excellent written and oral communication.
Python, C/C++, Rust, Go, Java, JavaScript, ReactJS
1d
Save
Mark Applied
Hide
Oliver Wyman - Senior Lead Engineer
New York City or Boston or Chicago or Washington
$195k-$250k/yr HybridFull Time
Requires a quantitative or computational technical background and proven experience designing and deploying large-scale AI systems, agent platforms, production pipelines, evaluation frameworks, and LLM solutions.
Azure Foundry, AWS Bedrock, Gemini Enterprise Agent Platform
2w
Save
Mark Applied
Hide
Senior Software Engineer, AI/ML
Chicago, Illinois, United States
$72k-$141k/yr HybridFull Time
4+ YOERequires a bachelor's degree or equivalent experience, 4+ years of application development, advanced Python, AI/ML, LLMs, Vertex AI, agent frameworks, prompt engineering, and model evaluation experience.
Python, Google Vertex AI, Gemini, OpenAI, Google Agent Development Kit, LangChain, LangGraph, LangSmith, LangFuse, Phoenix, Arize, Eval AI Testing
1mo
Save
Mark Applied
Hide
Agentic AI Architect - Intelligence Engineering (Central)
Austin or Chicago or Columbus or Dallas or Detroit or Houston or Indianapolis or Kansas City or Minneapolis or Nashville or St. Louis
$108k-$200k/yr HybridFull Time
5+ YOE5+ years software engineering experience with 2+ years focused on generative/agentic AI; experience designing multi-agent systems, RAG, cloud AI platforms, Python, API frameworks, evaluation/observability, and leading small teams.
Amazon Web Services, Azure, Google Cloud, AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Python, FastAPI, Flask, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, LangSmith, RAGAS, DeepEval, Claude Code, Cursor, Kiro, AutoGen, CrewAI, Semantic Kernel, Model Context Protocol (MCP)
2mo
Save
Mark Applied
Hide
Full Stack AI Product Engineer (DataEdge)
Atlanta or Austin or Chicago or Dallas or Houston
$79k-$95k/yr HybridFull Time
3+ YOE3+ years building production full-stack software with TypeScript and Python; experience with production AI systems, agentic workflows, RAG, LangChain/LangGraph, containerization, and evaluation/regression gates.
TypeScript, Python, Node.js, LangGraph, LangChain, FastAPI, Pydantic v2, pytest, Docker, Kubernetes, Helm, Temporal, pgvector, OpenSearch, Express, Bun, Koa, Fastify, NestJS, tRPC, Zod, OpenAPI codegen, yarn, pnpm, npm, ESLint, Prettier, Vitest, Jest, Vite, Turbopack, esbuild, Cursor, GitHub Copilot
1w
Save
Mark Applied
Hide
Senior Software Engineer - Agentic AI Engineer
Dallas or Atlanta or Chicago or Nashville
$73k-$174k/yr HybridFull Time
10+ YOE10+ years of related experience; advanced SQL and Python skills; experience with Vertex AI, Model Garden, Vertex AI Pipelines, model evaluation, BigQuery, Google Cloud Storage, and real-time data processing.
Vertex AI Agent Builder, Agent Developer Kit, Model Context Protocol (MCP) Toolbox, BigQuery, Spanner, Vertex AI, Dataflow, RunInference API, AlloyDB, Model Garden, Vertex AI Pipelines, SQL, Python, Google Cloud Storage
3w
Save
Mark Applied
Hide
Deployed Engineer (Chicago)
Chicago, Illinois, United States
$150k-$250k/yr RemoteFull Time
6+ YOERequires 6+ years in a relevant technical role, strong Python and JavaScript, systems fundamentals, production AI agent experience, customer-facing technical evaluation skills, and clear communication.
Python, JavaScript, LangChain, LangGraph, AWS, GCP, Azure, Kubernetes
2mo
Save
Mark Applied
Hide
Senior Applied AI Solutions Architect — Amazon Connect, Applied AI SA - AIVT
Seattle or Arlington or Atlanta or New York or Denver or Herndon or Chicago or Mountain View or San Francisco
$154k-$239k/yr OnsiteFull Time
7+ YOE7+ years in technology domains; 3+ years in design/implementation; familiarity with MCP/A2A; AI/ML concepts incl. LLMs, prompt engineering, RAG, model evaluation
Python, Node.js, AWS Lambda, API Gateway, Step Functions, Bedrock, MCP, RAG, DynamoDB, RDS, S3, OpenSearch, Kendra
1d
Save
Mark Applied
Hide
Senior AI Applied Manager
San Francisco or Chicago or Denver or Los Angeles or Phoenix
$125k-$186k/yr OnsiteFull Time
8+ YOERequires 8+ years of software engineering experience, expert Python, strong AWS and data skills, LLM evaluation and agentic systems experience, communication ability, and a bachelor's degree in computer science or engineering.
Python, AWS, SQL, Dataiku (DSS), OpenAI AgentKit, ChatKit, Apps SDK/MCP
1d
Save
Mark Applied
Hide
Principal Technical Consultant - AI/Cloud Platform Engineering
United States or Chicago or New York City
$230k-$290k/yr RemoteFull Time
8+ YOERequires 8+ years in engineering or technical consulting, 5+ years delivering Azure infrastructure or migrations, 18+ months delivering GenAI or agent systems, and hands-on Azure, AI platform, IaC, CI/CD, evaluation, and client leadership expertise.
Microsoft Azure, Azure Migrate, ExpressRoute, VPN gateways, GitHub Actions, Microsoft Foundry, Copilot Studio, Foundry SDK, Python, OpenAI, Anthropic, Azure AI Search, Terraform, Bicep, ARM, Microsoft Entra ID, pac CLI, Microsoft Purview, Application Insights, Copilot Agent Kit
2w
Save
Mark Applied
Hide
Senior Product Manager, AI & Data Science Products
Seattle or Richmond or Austin or North Charleston or Philadelphia or San Francisco or Denver or Miami or Atlanta or Chicago or Augusta or Boston or Las Vegas or Trenton or New York or Raleigh or Portland
RemoteFull Time
3+ YOERequires 3+ years of product management or comparable experience, customer-facing AI or data product ownership, applied AI/ML knowledge, data science and engineering collaboration, experimentation, analytics, and quality evaluation skills.
AI, machine learning, APIs, MCP
3mo
Save
Mark Applied
Hide
Legal Engineering Attorney
New York or Boston or Los Angeles or Chicago or Washington
$220k-$250k/yr HybridFull Time
3+ YOEJ.D. required; 3+ years substantive legal practice and 2+ years legal engineering experience. Experience authoring prompts and working with JSON/JSON Schema/YAML/Markdown and evaluating AI outputs.
JSON, JSON Schema, YAML, Markdown
2mo
Save
Mark Applied
Hide
Data Scientist
Chicago or United States
$90k-$120k/yr HybridFull Time
3+ YOE3+ years experience with a bachelor’s in a quantitative field; strong Python and SQL skills; hands-on Agentic and Generative AI experience, prompt engineering, model evaluation, Tableau/Power BI experience; must be authorized to work in the U.S.
Python, SQL, Tableau, Microsoft Power BI, Claude Code, GitHub Copilot, Amazon SageMaker, Amazon Bedrock, AWS Lambda, Amazon S3, Snowflake
Explore Jobs
Expand Your Job Search
Top Cities Near Kenosha for AI Evaluation Engineer
- AI Evaluation Engineer jobs in Milwaukee, WI
- AI Evaluation Engineer jobs in Elgin, IL
- AI Evaluation Engineer jobs in Waukegan, IL
- AI Evaluation Engineer jobs in Racine, WI
- AI Evaluation Engineer jobs in Arlington Heights, IL
- AI Evaluation Engineer jobs in Evanston, IL
- AI Evaluation Engineer jobs in Schaumburg, IL
- AI Evaluation Engineer jobs in Waukesha, WI
- AI Evaluation Engineer jobs in Palatine, IL
- AI Evaluation Engineer jobs in Skokie, IL
- AI Evaluation Engineer jobs in West Allis, WI
- AI Evaluation Engineer jobs in Des Plaines, IL
- AI Evaluation Engineer jobs in Mount Prospect, IL
- AI Evaluation Engineer jobs in Oak Park, IL
- AI Evaluation Engineer jobs in Hoffman Estates, IL
- AI Evaluation Engineer jobs in Wauwatosa, WI
- AI Evaluation Engineer jobs in Glenview, IL
- AI Evaluation Engineer jobs in Elmhurst, IL
- AI Evaluation Engineer jobs in Lombard, IL
- AI Evaluation Engineer jobs in Bartlett, IL