23 ai evaluation engineer jobs at 21 companies in Georgia
2mo
Save
Mark Applied
Hide
Senior AI Engineer
Atlanta, Georgia, United States
OnsiteFull Time
4+ YOE4+ years related experience building and deploying production AI systems; strong LLM, prompting, embeddings, retrieval/RAG, agentic workflows, API and system design skills; experimentation and evaluation experience.
LLM, AgentCore, embeddings, vector search, RAG, APIs
16h
Save
Mark Applied
Hide
Senior AI Engineer
Alpharetta, Georgia, United States
OnsiteFull Time
5+ YOERequires 5–8+ years of software engineering experience, production AI/LLM API integration, prompt engineering, RAG, Python, evaluation and guardrails, plus a bachelor's degree or equivalent practical experience.
Azure AI, Azure OpenAI, Azure AI Foundry, Azure AI Search, Python, RAG, Vector databases, LangChain, LlamaIndex, Semantic Kernel, Model Context Protocol (MCP)
3w
Save
Mark Applied
Hide
AI Engineer - GA
Georgia, United States
OnsiteFull Time
5+ YOE5+ years of AI/ML engineering experience evaluating, fine-tuning, and deploying production LLMs; cloud infrastructure, RAG, embeddings, vector databases, agentic workflows, EvalOps, and production software engineering required.
LLM, RAG, EvalOps, AWS, GCP
2d
Save
Mark Applied
Hide
AI Engineer
New York City or United States or Raleigh-Durham or Atlanta or Philadelphia
$150k-$300k/yr HybridFull Time
Production experience launching LLM or agent products, strong Python, agent frameworks, RAG, prompt engineering, evaluation systems, ML tools, orchestration workflows, and stakeholder communication.
Python, AWS, PyTorch, scikit-learn, SQL, Spark, Airflow, ZenML, Kedro, dbt
1d
Save
Mark Applied
Hide
AI Engineer
Washington, D.C. or Atlanta or San Francisco
$223k-$259k/yr RemoteFull Time
5+ YOE5+ years of software engineering experience, including production LLM systems. Requires agentic systems expertise, strong Python, developer tooling, evaluation methods, systems fundamentals, ownership, and communication skills.
Python, Pydantic, MCP, OpenTelemetry, vLLM, Rust, Swift, Kotlin, Xcode, iOS simulators, CLIs, CI/CD
1mo
Save
Mark Applied
Hide
AI Innovation Engineer
Atlanta, Georgia, United States
OnsiteFull Time
2+ YOEBachelor's in technical or business field,2+ years engineering/data experience,proficiency in C#,Python,TypeScript,JavaScript,React,APIs,cloud architectures,CI/CD and AI/ML concepts;strong communication and evaluation skills.
C#, Python, TypeScript, JavaScript, React, APIs, ETL/ELT, CI/CD, Git, Claude Code, Codex, Microsoft Azure, Microsoft Fabric, Power Platform, Azure AI Foundry
3w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
1mo
Save
Mark Applied
Hide
Senior AI Platform Engineer
San Francisco or Alabama or Arkansas or California or Colorado or Florida or Georgia or Illinois or Kentucky or Massachusetts or Michigan or Montana or Missouri or Nevada or New Jersey or New York or North Carolina or Oregon or Pennsylvania or Texas or Washington or Utah or Virginia or Wisconsin
$156k-$231k/yr HybridFull Time
3+ YOE3+ years building production software or ML/data systems; strong Python and systems/API design; experience with LLM retrieval/RAG, agents, evaluation, Databricks/MLflow and modern data stacks.
Python, PySpark, dbt, Databricks, Delta Lake, Unity Catalog, MLflow, Astronomer, Airflow, Claude, GitHub, Shortcut, Notion, pgvector, Pinecone, Weaviate, LangGraph, MCP
1w
Save
Mark Applied
Hide
Senior AI/ML Engineer
Lisbon or Atlanta or London or San Francisco or Santiago or Sydney or Tokyo or Toronto or Australia or Canada or United States
HybridFull Time
5+ YOE5+ years of software engineering experience building production distributed systems and AI systems, with expertise in LLMs, agents, retrieval, cloud infrastructure, containers, Kubernetes, reliability, and evaluation.
LLM, Kubernetes, AWS, GCP, Azure, LangChain, LlamaIndex, Kafka, Airflow, Spark
1mo
Save
Mark Applied
Hide
ETS - AI Research Engineer
Ghent or Atlanta or London or Hyderabad
HybridFull Time
3+ YOE3-5 years experience in data science/AI engineering, degree in CS/AI/ML or related, strong Python skills, experience designing and running experiments on LLM/agentic systems, evaluation framework design, familiarity with LangChain/Semantic Kernel/AutoGen and agent orchestration.
LangChain, Semantic Kernel, AutoGen, GitHub Copilot, Claude Code, Copilot Studio, Microsoft Dynamics 365, Power Platform, Python
2mo
Save
Mark Applied
Hide
Full Stack AI Product Engineer (DataEdge)
Atlanta or Austin or Chicago or Dallas or Houston
$79k-$95k/yr HybridFull Time
3+ YOE3+ years building production full-stack software with TypeScript and Python; experience with production AI systems, agentic workflows, RAG, LangChain/LangGraph, containerization, and evaluation/regression gates.
TypeScript, Python, Node.js, LangGraph, LangChain, FastAPI, Pydantic v2, pytest, Docker, Kubernetes, Helm, Temporal, pgvector, OpenSearch, Express, Bun, Koa, Fastify, NestJS, tRPC, Zod, OpenAPI codegen, yarn, pnpm, npm, ESLint, Prettier, Vitest, Jest, Vite, Turbopack, esbuild, Cursor, GitHub Copilot
1mo
Save
Mark Applied
Hide
AI DevEx Engineer
Atlanta or Alpharetta
OnsiteFull Time
Experienced in LLM/agent orchestration, AI debugging/evaluation, Full Stack Agentic Development, MCP integrations, strong communication, and practical experience with .NET and React preferred.
Claude Code, .NET, React, MCP, Evals, Retrieval-Augmented Generation (RAG)
3w
Save
Mark Applied
Hide
Manager, Conversational AI
United States or California or Florida or Georgia or Idaho or Illinois or Massachusetts or Michigan or New Jersey or New York or North Carolina or Ohio or Oregon or Pennsylvania or Texas or Virginia or Washington or Wisconsin
RemoteFull Time
Experience leading teams and building conversational AI products, including LLM-powered agents, evaluation frameworks, optimization, experimentation, and cross-functional delivery with Product, Engineering, Data, and AI teams.
AI, Machine Learning, LLM
1w
Save
Mark Applied
Hide
Senior Electrical Engineer – MV AI UPS Data Centers & Storage
Alpharetta or Atlanta or Miami or Tysons or United States
RemoteFull Time
8+ YOERequires 8+ years of electrical engineering experience focused on battery systems, BESS evaluation, inverter/PCS validation, EMS or Plant Controller integration, SCADA, PSCAD, MATLAB, and engineering analysis tools.
Python, VS Code, Jupyter Notebooks, Git, PSCAD, MATLAB, SCADA, EMS
1w
Save
Mark Applied
Hide
Senior Software Engineer - Agentic AI Engineer
Dallas or Atlanta or Chicago or Nashville
$73k-$174k/yr HybridFull Time
10+ YOE10+ years of related experience; advanced SQL and Python skills; experience with Vertex AI, Model Garden, Vertex AI Pipelines, model evaluation, BigQuery, Google Cloud Storage, and real-time data processing.
Vertex AI Agent Builder, Agent Developer Kit, Model Context Protocol (MCP) Toolbox, BigQuery, Spanner, Vertex AI, Dataflow, RunInference API, AlloyDB, Model Garden, Vertex AI Pipelines, SQL, Python, Google Cloud Storage
1mo
Save
Mark Applied
Hide
Agentic AI Architect - Intelligence Engineering (East)
Atlanta or Boston or Charlotte or Hartford or Miami or New Brunswick or New York City or Philadelphia or Raleigh or Washington
$108k-$218k/yr HybridFull Time
5+ YOE5+ years software engineering experience with 2+ years on generative/agentic AI; experience designing multi-agent systems, RAG, cloud AI platforms, Python and API frameworks, evaluation and governance for production AI systems.
Amazon Web Services, Azure, Google Cloud, AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, Model Context Protocol (MCP), LangSmith, RAGAS, DeepEval, Claude Code, Cursor, Kiro, Python, FastAPI, Flask
2mo
Save
Mark Applied
Hide
Senior Applied AI Solutions Architect — Amazon Connect, Applied AI SA - AIVT
Seattle or Arlington or Atlanta or New York or Denver or Herndon or Chicago or Mountain View or San Francisco
$154k-$239k/yr OnsiteFull Time
7+ YOE7+ years in technology domains; 3+ years in design/implementation; familiarity with MCP/A2A; AI/ML concepts incl. LLMs, prompt engineering, RAG, model evaluation
Python, Node.js, AWS Lambda, API Gateway, Step Functions, Bedrock, MCP, RAG, DynamoDB, RDS, S3, OpenSearch, Kendra
1d
Save
Mark Applied
Hide
Engineer Lead (FDE) - AI Assurance and Evaluations
Atlanta, Georgia, United States
HybridFull Time
7+ YOEBA/BS in information technology, computer science, or related field plus 7+ years of related experience. Requires expert application experience, Python, API testing, test automation, LLM evaluation, analytics, and mentoring.
Python, REST, JSON, SQL, CI pipelines
2w
Save
Mark Applied
Hide
Senior Software Engineer
Redmond or Mountain View or Atlanta or New York City
$120k-$235k/yr HybridFull Time
4+ YOEBachelor’s degree in computer science or related field plus 4+ years of coding experience, or equivalent experience. Preferred experience includes AI applications, APIs, enterprise tools, evaluation, and Azure technologies.
C, C++, C#, Java, JavaScript, Python, Microsoft Azure, Microsoft 365, Copilot, GitHub Copilot, Copilot Studio, Power Platform
2w
Save
Mark Applied
Hide
Senior Product Manager, AI & Data Science Products
Seattle or Richmond or Austin or North Charleston or Philadelphia or San Francisco or Denver or Miami or Atlanta or Chicago or Augusta or Boston or Las Vegas or Trenton or New York or Raleigh or Portland
RemoteFull Time
3+ YOERequires 3+ years of product management or comparable experience, customer-facing AI or data product ownership, applied AI/ML knowledge, data science and engineering collaboration, experimentation, analytics, and quality evaluation skills.
AI, machine learning, APIs, MCP
Explore Jobs
Expand Your Job Search
Top Cities in Georgia for AI Evaluation Engineer
- AI Evaluation Engineer jobs in Atlanta, GA
- AI Evaluation Engineer jobs in Columbus, GA
- AI Evaluation Engineer jobs in Savannah, GA
- AI Evaluation Engineer jobs in Athens, GA
- AI Evaluation Engineer jobs in South Fulton, GA
- AI Evaluation Engineer jobs in Sandy Springs, GA
- AI Evaluation Engineer jobs in Roswell, GA
- AI Evaluation Engineer jobs in Macon, GA
- AI Evaluation Engineer jobs in Johns Creek, GA
- AI Evaluation Engineer jobs in Albany, GA
- AI Evaluation Engineer jobs in Warner Robins, GA
- AI Evaluation Engineer jobs in Alpharetta, GA
- AI Evaluation Engineer jobs in Marietta, GA
- AI Evaluation Engineer jobs in Smyrna, GA
- AI Evaluation Engineer jobs in Valdosta, GA
- AI Evaluation Engineer jobs in Brookhaven, GA
- AI Evaluation Engineer jobs in Stonecrest, GA
- AI Evaluation Engineer jobs in Dunwoody, GA
- AI Evaluation Engineer jobs in Augusta, GA
- AI Evaluation Engineer jobs in Peachtree Corners, GA