19 ai evaluation engineer jobs at 18 companies in Smyrna, GA
2mo
Save
Mark Applied
Hide
Senior AI Engineer
Atlanta, Georgia, United States
OnsiteFull Time
4+ YOE4+ years related experience building and deploying production AI systems; strong LLM, prompting, embeddings, retrieval/RAG, agentic workflows, API and system design skills; experimentation and evaluation experience.
LLM, AgentCore, embeddings, vector search, RAG, APIs
20h
Save
Mark Applied
Hide
Senior AI Engineer
Alpharetta, Georgia, United States
OnsiteFull Time
5+ YOERequires 5–8+ years of software engineering experience, production AI/LLM API integration, prompt engineering, RAG, Python, evaluation and guardrails, plus a bachelor's degree or equivalent practical experience.
Azure AI, Azure OpenAI, Azure AI Foundry, Azure AI Search, Python, RAG, Vector databases, LangChain, LlamaIndex, Semantic Kernel, Model Context Protocol (MCP)
3d
Save
Mark Applied
Hide
AI Engineer
New York City or United States or Raleigh-Durham or Atlanta or Philadelphia
$150k-$300k/yr HybridFull Time
Production experience launching LLM or agent products, strong Python, agent frameworks, RAG, prompt engineering, evaluation systems, ML tools, orchestration workflows, and stakeholder communication.
Python, AWS, PyTorch, scikit-learn, SQL, Spark, Airflow, ZenML, Kedro, dbt
1d
Save
Mark Applied
Hide
AI Engineer
Washington, D.C. or Atlanta or San Francisco
$223k-$259k/yr RemoteFull Time
5+ YOE5+ years of software engineering experience, including production LLM systems. Requires agentic systems expertise, strong Python, developer tooling, evaluation methods, systems fundamentals, ownership, and communication skills.
Python, Pydantic, MCP, OpenTelemetry, vLLM, Rust, Swift, Kotlin, Xcode, iOS simulators, CLIs, CI/CD
1mo
Save
Mark Applied
Hide
AI Innovation Engineer
Atlanta, Georgia, United States
OnsiteFull Time
2+ YOEBachelor's in technical or business field,2+ years engineering/data experience,proficiency in C#,Python,TypeScript,JavaScript,React,APIs,cloud architectures,CI/CD and AI/ML concepts;strong communication and evaluation skills.
C#, Python, TypeScript, JavaScript, React, APIs, ETL/ELT, CI/CD, Git, Claude Code, Codex, Microsoft Azure, Microsoft Fabric, Power Platform, Azure AI Foundry
4w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
1w
Save
Mark Applied
Hide
Senior AI/ML Engineer
Lisbon or Atlanta or London or San Francisco or Santiago or Sydney or Tokyo or Toronto or Australia or Canada or United States
HybridFull Time
5+ YOE5+ years of software engineering experience building production distributed systems and AI systems, with expertise in LLMs, agents, retrieval, cloud infrastructure, containers, Kubernetes, reliability, and evaluation.
LLM, Kubernetes, AWS, GCP, Azure, LangChain, LlamaIndex, Kafka, Airflow, Spark
1mo
Save
Mark Applied
Hide
ETS - AI Research Engineer
Ghent or Atlanta or London or Hyderabad
HybridFull Time
3+ YOE3-5 years experience in data science/AI engineering, degree in CS/AI/ML or related, strong Python skills, experience designing and running experiments on LLM/agentic systems, evaluation framework design, familiarity with LangChain/Semantic Kernel/AutoGen and agent orchestration.
LangChain, Semantic Kernel, AutoGen, GitHub Copilot, Claude Code, Copilot Studio, Microsoft Dynamics 365, Power Platform, Python
2mo
Save
Mark Applied
Hide
Full Stack AI Product Engineer (DataEdge)
Atlanta or Austin or Chicago or Dallas or Houston
$79k-$95k/yr HybridFull Time
3+ YOE3+ years building production full-stack software with TypeScript and Python; experience with production AI systems, agentic workflows, RAG, LangChain/LangGraph, containerization, and evaluation/regression gates.
TypeScript, Python, Node.js, LangGraph, LangChain, FastAPI, Pydantic v2, pytest, Docker, Kubernetes, Helm, Temporal, pgvector, OpenSearch, Express, Bun, Koa, Fastify, NestJS, tRPC, Zod, OpenAPI codegen, yarn, pnpm, npm, ESLint, Prettier, Vitest, Jest, Vite, Turbopack, esbuild, Cursor, GitHub Copilot
1mo
Save
Mark Applied
Hide
AI DevEx Engineer
Atlanta or Alpharetta
OnsiteFull Time
Experienced in LLM/agent orchestration, AI debugging/evaluation, Full Stack Agentic Development, MCP integrations, strong communication, and practical experience with .NET and React preferred.
Claude Code, .NET, React, MCP, Evals, Retrieval-Augmented Generation (RAG)
1w
Save
Mark Applied
Hide
Senior Electrical Engineer – MV AI UPS Data Centers & Storage
Alpharetta or Atlanta or Miami or Tysons or United States
RemoteFull Time
8+ YOERequires 8+ years of electrical engineering experience focused on battery systems, BESS evaluation, inverter/PCS validation, EMS or Plant Controller integration, SCADA, PSCAD, MATLAB, and engineering analysis tools.
Python, VS Code, Jupyter Notebooks, Git, PSCAD, MATLAB, SCADA, EMS
1w
Save
Mark Applied
Hide
Senior Software Engineer - Agentic AI Engineer
Dallas or Atlanta or Chicago or Nashville
$73k-$174k/yr HybridFull Time
10+ YOE10+ years of related experience; advanced SQL and Python skills; experience with Vertex AI, Model Garden, Vertex AI Pipelines, model evaluation, BigQuery, Google Cloud Storage, and real-time data processing.
Vertex AI Agent Builder, Agent Developer Kit, Model Context Protocol (MCP) Toolbox, BigQuery, Spanner, Vertex AI, Dataflow, RunInference API, AlloyDB, Model Garden, Vertex AI Pipelines, SQL, Python, Google Cloud Storage
1mo
Save
Mark Applied
Hide
Agentic AI Architect - Intelligence Engineering (East)
Atlanta or Boston or Charlotte or Hartford or Miami or New Brunswick or New York City or Philadelphia or Raleigh or Washington
$108k-$218k/yr HybridFull Time
5+ YOE5+ years software engineering experience with 2+ years on generative/agentic AI; experience designing multi-agent systems, RAG, cloud AI platforms, Python and API frameworks, evaluation and governance for production AI systems.
Amazon Web Services, Azure, Google Cloud, AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, Model Context Protocol (MCP), LangSmith, RAGAS, DeepEval, Claude Code, Cursor, Kiro, Python, FastAPI, Flask
2mo
Save
Mark Applied
Hide
Senior Applied AI Solutions Architect — Amazon Connect, Applied AI SA - AIVT
Seattle or Arlington or Atlanta or New York or Denver or Herndon or Chicago or Mountain View or San Francisco
$154k-$239k/yr OnsiteFull Time
7+ YOE7+ years in technology domains; 3+ years in design/implementation; familiarity with MCP/A2A; AI/ML concepts incl. LLMs, prompt engineering, RAG, model evaluation
Python, Node.js, AWS Lambda, API Gateway, Step Functions, Bedrock, MCP, RAG, DynamoDB, RDS, S3, OpenSearch, Kendra
1d
Save
Mark Applied
Hide
Engineer Lead (FDE) - AI Assurance and Evaluations
Atlanta, Georgia, United States
HybridFull Time
7+ YOEBA/BS in information technology, computer science, or related field plus 7+ years of related experience. Requires expert application experience, Python, API testing, test automation, LLM evaluation, analytics, and mentoring.
Python, REST, JSON, SQL, CI pipelines
2w
Save
Mark Applied
Hide
Senior Software Engineer
Redmond or Mountain View or Atlanta or New York City
$120k-$235k/yr HybridFull Time
4+ YOEBachelor’s degree in computer science or related field plus 4+ years of coding experience, or equivalent experience. Preferred experience includes AI applications, APIs, enterprise tools, evaluation, and Azure technologies.
C, C++, C#, Java, JavaScript, Python, Microsoft Azure, Microsoft 365, Copilot, GitHub Copilot, Copilot Studio, Power Platform
2w
Save
Mark Applied
Hide
Senior Product Manager, AI & Data Science Products
Seattle or Richmond or Austin or North Charleston or Philadelphia or San Francisco or Denver or Miami or Atlanta or Chicago or Augusta or Boston or Las Vegas or Trenton or New York or Raleigh or Portland
RemoteFull Time
3+ YOERequires 3+ years of product management or comparable experience, customer-facing AI or data product ownership, applied AI/ML knowledge, data science and engineering collaboration, experimentation, analytics, and quality evaluation skills.
AI, machine learning, APIs, MCP
3mo
Save
Mark Applied
Hide
Chemistry - Graduates - AI Training - Atlanta, US
Atlanta, Georgia, United States
$60/hr RemotePart Time, Contract
BS/MS/PhD in Chemistry, Chemical Engineering, Biochemistry or related; laboratory or industrial experience preferred; strong knowledge of chemistry principles, safety protocols (SDS/GHS), IUPAC nomenclature, and ability to evaluate and annotate chemical data. PayPal account required.
SMILES, NMR, IR, Mass Spec, IUPAC, PayPal
2mo
Save
Mark Applied
Hide
Content Automation and GenAI - Consulting and Delivery Manager
New York City or Milwaukee or Herndon or Dallas or Columbus or Kirkland or Irvine or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or Arlington or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or San Francisco or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$266k/yr OnsiteFull Time
7+ YOE7+ years client-facing consulting or digital transformation experience; hands-on experience evaluating/applying content automation or GenAI tools and delivering GenAI POCs; strong understanding of LLM concepts, prompt engineering, safety/responsible AI, content operations, and team leadership.
OpenAI, Google Gemini, M365 Copilot, Writer, FireFly, ChatGPT, Adobe Workfront, AEM, CMS, DAM, PIM
Explore Jobs
Expand Your Job Search
Top Cities Near Smyrna for AI Evaluation Engineer
- AI Evaluation Engineer jobs in Atlanta, GA
- AI Evaluation Engineer jobs in South Fulton, GA
- AI Evaluation Engineer jobs in Sandy Springs, GA
- AI Evaluation Engineer jobs in Roswell, GA
- AI Evaluation Engineer jobs in Johns Creek, GA
- AI Evaluation Engineer jobs in Alpharetta, GA
- AI Evaluation Engineer jobs in Marietta, GA
- AI Evaluation Engineer jobs in Brookhaven, GA
- AI Evaluation Engineer jobs in Stonecrest, GA
- AI Evaluation Engineer jobs in Dunwoody, GA
- AI Evaluation Engineer jobs in Peachtree Corners, GA
- AI Evaluation Engineer jobs in Gainesville, GA
- AI Evaluation Engineer jobs in Milton, GA
- AI Evaluation Engineer jobs in Newnan, GA
- AI Evaluation Engineer jobs in Rome, GA
- AI Evaluation Engineer jobs in East Point, GA
- AI Evaluation Engineer jobs in Peachtree City, GA
- AI Evaluation Engineer jobs in Kennesaw, GA
- AI Evaluation Engineer jobs in Douglasville, GA
- AI Evaluation Engineer jobs in Lawrenceville, GA