37 ai evaluation jobs at 29 companies in Atlanta, GA
1mo
Save
Mark Applied
Hide
Director, AI Enablement
Atlanta, Georgia, United States
OnsiteFull Time
5+ YOE5+ years in AI enablement, program management, or digital transformation; experience evaluating AI tools and vendors; designing training; prototyping with LLMs; strong stakeholder engagement and vendor management skills.
LLMs, Anthropic Claude, OpenAI GPT, Microsoft Copilot, MCP, Microsoft Azure, Azure Data Lake, Synapse Analytics, Azure Machine Learning, Azure OpenAI
1mo
Save
Mark Applied
Hide
Senior AI Engineer
Atlanta, Georgia, United States
OnsiteFull Time
4+ YOE4+ years related experience building and deploying production AI systems; strong LLM, prompting, embeddings, retrieval/RAG, agentic workflows, API and system design skills; experimentation and evaluation experience.
LLM, AgentCore, embeddings, vector search, RAG, APIs
2mo
Save
Mark Applied
Hide
Principle AI Security Architect
Atlanta, Georgia, United States
OnsiteFull Time
Define AI/ML security architecture; evaluate tools; implement DevSecOps for AI; govern risk and compliance; provide incident response guidance.
Azure ML, Azure OpenAI, Microsoft Copilot security patterns, Microsoft Entra ID, Microsoft Defender, Purview
2w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
2w
Save
Mark Applied
Hide
AI Automation Co-Op
Suwanee, Georgia, United States
$50k-$70k/yr OnsiteInternship
Currently pursuing a bachelor’s in Engineering, Computer Science, or related field; experience with AI tools and ability to evaluate AI outputs; strong analytical, communication, and project skills.
Microsoft Copilot, Python, scikit-learn, PyTorch
1mo
Save
Mark Applied
Hide
AI Innovation Engineer
Atlanta, Georgia, United States
OnsiteFull Time
2+ YOEBachelor's in technical or business field,2+ years engineering/data experience,proficiency in C#,Python,TypeScript,JavaScript,React,APIs,cloud architectures,CI/CD and AI/ML concepts;strong communication and evaluation skills.
C#, Python, TypeScript, JavaScript, React, APIs, ETL/ELT, CI/CD, Git, Claude Code, Codex, Microsoft Azure, Microsoft Fabric, Power Platform, Azure AI Foundry
1d
Save
Mark Applied
Hide
AI Engineer
New York City or United States or Raleigh-Durham or Atlanta or Philadelphia
$150k-$300k/yr HybridFull Time
Production experience launching LLM or agent products; strong Python; agent frameworks, RAG, prompt engineering, evaluation systems, ML tools, orchestration workflows, and technical communication skills.
Python, AWS, PyTorch, scikit-learn, SQL, Spark, Airflow, ZenML, Kedro, dbt
1mo
Save
Mark Applied
Hide
ETS - AI Research Engineer
Ghent or Atlanta or London or Hyderabad
HybridFull Time
3+ YOE3-5 years experience in data science/AI engineering, degree in CS/AI/ML or related, strong Python skills, experience designing and running experiments on LLM/agentic systems, evaluation framework design, familiarity with LangChain/Semantic Kernel/AutoGen and agent orchestration.
LangChain, Semantic Kernel, AutoGen, GitHub Copilot, Claude Code, Copilot Studio, Microsoft Dynamics 365, Power Platform, Python
1mo
Save
Mark Applied
Hide
Agentic AI Architect - Intelligence Engineering (East)
Atlanta or Boston or Charlotte or Hartford or Miami or New Brunswick or New York City or Philadelphia or Raleigh or Washington
$108k-$218k/yr HybridFull Time
5+ YOE5+ years software engineering experience with 2+ years on generative/agentic AI; experience designing multi-agent systems, RAG, cloud AI platforms, Python and API frameworks, evaluation and governance for production AI systems.
Amazon Web Services, Azure, Google Cloud, AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, Model Context Protocol (MCP), LangSmith, RAGAS, DeepEval, Claude Code, Cursor, Kiro, Python, FastAPI, Flask
1d
Save
Mark Applied
Hide
Principal AI Red Team Operator
Cary or Alpharetta or Irving or Ashburn or Temple Terrace or Basking Ridge
$121k-$231k/yr HybridFull Time
6+ YOEBachelor's degree or equivalent experience, 6+ years of relevant experience, AI evaluation or security experience, adversarial prompting, AI compromise techniques, and strong cybersecurity knowledge.
MITRE ATLAS, OWASP, Ollama, LlamaFiles, Python, GCP, AWS, Azure
2d
Save
Mark Applied
Hide
Principal AI Red Team Operator
Cary or Alpharetta or Ashburn or Irving or Temple Terrace or Basking Ridge
$121k-$231k/yr HybridFull Time
6+ YOEBachelor’s degree or 4+ years relevant experience; 6+ years relevant experience; AI evaluations or AI safety/security systems; adversarial prompting, data poisoning, embedding inversion, and enterprise AI compromise experience.
MITRE ATLAS, OWASP, Ollama, LlamaFiles, Python, GCP, AWS, Azure, LLMs, RAG, GenAI
2d
Save
Mark Applied
Hide
Principal AI Red Team Operator
Cary or Alpharetta or Ashburn or Irving or Temple Terrace or Basking Ridge
$121k-$231k/yr HybridFull Time
6+ YOEBachelor's degree or equivalent experience, 6+ years relevant experience, AI evaluation or security experience, adversarial AI testing, cybersecurity knowledge, and Python, cloud, or web testing experience preferred.
MITRE ATLAS, OWASP, Ollama, LlamaFiles, Python, GCP, AWS, Azure
2w
Save
Mark Applied
Hide
AI and Data Product Manager
Atlanta, Georgia, United States
OnsiteFull Time
6+ YOE6+ years product management experience building AI/ML or data products, strong process-decomposition, SQL and analytics comfort, AI literacy (LLMs, RAG, agents), evaluation design, and change management skills.
LLMs, RAG, n8n, Zapier, Make, Workato, Celonis, UiPath, UiPath Maestro, MCP, A2A, ACP, SQL, Snowflake, Databricks, Spark, AWS, SIGMA, Tableau, Microsoft Power BI, Jira, Confluence, Productboard
2w
Save
Mark Applied
Hide
AI and Data Product Manager
Atlanta or Jacksonville
OnsiteFull Time
6+ YOE6+ years product management experience building AI/ML and data products; strong workflow decomposition, SQL/data literacy, AI literacy (LLMs, RAG, agents), evaluation design, change management, and stakeholder translation.
n8n, Zapier, Make, Workato, Celonis, UiPath, SQL, Snowflake, Databricks, Spark, AWS, SIGMA, Tableau, Microsoft Power BI, Jira, Confluence, Productboard
1w
Save
Mark Applied
Hide
Design Technology AI Lead (AEC Technology)
Charlotte or King of Prussia or Philadelphia or Somerville or Duluth
$100k-$125k/yr HybridFull Time
5+ YOERequires 5+ years in the AEC industry, software and AI tool evaluation or deployment experience, and working knowledge of Revit, Civil 3D, AutoCAD, Bluebeam, BIM 360, Autodesk Construction Cloud, and Microsoft 365.
Autodesk Assistant, Forma AI, SketchUp AI, Revit, Civil 3D, AutoCAD, Bluebeam, BIM 360, Autodesk Construction Cloud, Microsoft 365
2mo
Save
Mark Applied
Hide
Senior Applied AI Solutions Architect — Amazon Connect, Applied AI SA - AIVT
Seattle or Arlington or Atlanta or New York or Denver or Herndon or Chicago or Mountain View or San Francisco
$154k-$239k/yr OnsiteFull Time
7+ YOE7+ years in technology domains; 3+ years in design/implementation; familiarity with MCP/A2A; AI/ML concepts incl. LLMs, prompt engineering, RAG, model evaluation
Python, Node.js, AWS Lambda, API Gateway, Step Functions, Bedrock, MCP, RAG, DynamoDB, RDS, S3, OpenSearch, Kendra
2mo
Save
Mark Applied
Hide
Full Stack AI Product Engineer (DataEdge)
Atlanta or Austin or Chicago or Dallas or Houston
$79k-$95k/yr HybridFull Time
3+ YOE3+ years building production full-stack software with TypeScript and Python; experience with production AI systems, agentic workflows, RAG, LangChain/LangGraph, containerization, and evaluation/regression gates.
TypeScript, Python, Node.js, LangGraph, LangChain, FastAPI, Pydantic v2, pytest, Docker, Kubernetes, Helm, Temporal, pgvector, OpenSearch, Express, Bun, Koa, Fastify, NestJS, tRPC, Zod, OpenAPI codegen, yarn, pnpm, npm, ESLint, Prettier, Vitest, Jest, Vite, Turbopack, esbuild, Cursor, GitHub Copilot
3mo
Save
Mark Applied
Hide
AI Model Risk Validation Specialist
Dallas or Chicago or Atlanta or New York
$100k-$135k/yr HybridFull Time
5+ YOE5+ years in data science, model risk management, or AI/ML validation; experience with predictive models in regulated environments (insurance/financial services preferred); strong knowledge of machine learning, model evaluation, bias and fairness, and model governance.
Machine Learning, Statistical Modeling, Model Validation, Governance Frameworks
1w
Save
Mark Applied
Hide
Head of AI Safety
Massachusetts or Colorado or New York or Virginia or Georgia or Pennsylvania or Maryland or Wisconsin or Tennessee or Oregon or New Jersey or District of Columbia or Atlanta
$110k-$145k/yr RemoteFull Time
Experience in trust and safety, online harms, violence prevention, safeguarding, or public health; project and people management; evaluation framework design; strong writing, judgment, and stakeholder skills; US work eligibility.
LLMs
1mo
Save
Mark Applied
Hide
Capgemini Invent - AI and Product Innovation Senior Consultant (Atlanta, GA, US)
Atlanta, Georgia, United States
$101k-$190k/yr OnsiteFull Time
5+ YOE5+ years consulting/product/analytics experience with AI or data initiatives; strong knowledge of LLMs, data pipelines, model evaluation, and semantic layers; advanced storytelling and Excel skills; ability to structure ambiguous problems.
OpenAI, Anthropic, Google Gemini, LangGraph, CrewAI, dbt, LookML, Microsoft Excel
Explore Jobs
Expand Your Job Search
Top Cities Near Atlanta for AI Evaluation
- AI Evaluation jobs in South Fulton, GA
- AI Evaluation jobs in Sandy Springs, GA
- AI Evaluation jobs in Roswell, GA
- AI Evaluation jobs in Johns Creek, GA
- AI Evaluation jobs in Alpharetta, GA
- AI Evaluation jobs in Marietta, GA
- AI Evaluation jobs in Smyrna, GA
- AI Evaluation jobs in Brookhaven, GA
- AI Evaluation jobs in Stonecrest, GA
- AI Evaluation jobs in Dunwoody, GA
- AI Evaluation jobs in Peachtree Corners, GA
- AI Evaluation jobs in Gainesville, GA
- AI Evaluation jobs in Milton, GA
- AI Evaluation jobs in Newnan, GA
- AI Evaluation jobs in East Point, GA
- AI Evaluation jobs in Peachtree City, GA
- AI Evaluation jobs in Kennesaw, GA
- AI Evaluation jobs in Douglasville, GA
- AI Evaluation jobs in Lawrenceville, GA
- AI Evaluation jobs in Woodstock, GA