11 ai evaluation engineer jobs at 8 companies in Concord, NC
2w
Save
Mark Applied
Hide
Observability & Evaluation Engineer
Charlotte, North Carolina, United States
HybridFull Time
7+ YOERequires 7+ years of engineering experience, 5+ years of Python, observability, LLM evaluation, Agile, and production support experience; knowledge of RAG, AI quality, telemetry, and monitoring.
Python, Kubernetes, CI/CD
2mo
Save
Mark Applied
Hide
AI Agent Engineer
Charlotte or San Francisco or Los Angeles or New York City
$95k-$120k/yr OnsiteFull Time
4+ YOEBachelor's degree or equivalent experience, 4+ years in MLOps/AI/ML engineering or data engineering, hands-on Databricks and MLflow experience, strong Python and SQL skills, experience with agent frameworks and evaluation/monitoring of non-deterministic AI systems.
Databricks, Mosaic AI, Databricks Agent Framework, Databricks Vector Search, MLflow, Python, LangChain, LlamaIndex, AutoGen, SQL, Delta Lake, Unity Catalog, CI/CD, Sigma, Microsoft Power BI, Streamlit, Gradio
1mo
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
1d
Save
Mark Applied
Hide
Senior AI Platform Engineer
Charlotte, North Carolina, United States
HybridFull Time
7+ YOE7+ years building and operating production software or automation systems, including 3+ years resolving production failures; Python or equivalent coding, API and AI/LLM integration, cloud identity, evaluation, and production ownership experience.
Python, Microsoft Copilot, Microsoft Copilot Studio, Microsoft Graph API, Microsoft SharePoint, Microsoft Teams, Microsoft Power Platform, Model Context Protocols (MCPs), Microsoft Azure, Amazon Web Services, Azure AI Foundry, REST APIs, APIs, webhooks
3w
Save
Mark Applied
Hide
Technical Support Engineer - AI Lead
Redmond or Fargo or Las Colinas or Charlotte or San Francisco or New York City
$131k-$277k/yr HybridFull Time
10+ YOEBachelor's degree in computer science, IT, or related field and 10+ years of technical support, consulting, or IT experience; expertise in AI/ML, governance, evaluation, and executive stakeholder management.
AI, Responsible AI, LLM, agentic, AI/ML
2mo
Save
Mark Applied
Hide
VP Mgr-Applied AI Engineering
Charlotte, North Carolina, United States
$169k-$245k/yr OnsiteFull Time
Deep LLM and AI architecture expertise; leadership of technical teams; AI evaluation, routing, fine-tuning, DevOps, infrastructure, governance, and responsible AI experience; bachelor's or master's degree in a technical field.
LLMs, UI/UX, DevOps, CI/CD, infrastructure as code
2mo
Save
Mark Applied
Hide
Agentic AI Architect - Intelligence Engineering (East)
Atlanta or Boston or Charlotte or Hartford or Miami or New Brunswick or New York City or Philadelphia or Raleigh or Washington
$108k-$218k/yr HybridFull Time
5+ YOE5+ years software engineering experience with 2+ years on generative/agentic AI; experience designing multi-agent systems, RAG, cloud AI platforms, Python and API frameworks, evaluation and governance for production AI systems.
Amazon Web Services, Azure, Google Cloud, AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, Model Context Protocol (MCP), LangSmith, RAGAS, DeepEval, Claude Code, Cursor, Kiro, Python, FastAPI, Flask
3w
Save
Mark Applied
Hide
GenAI Engineer
Charlotte or Dallas or Houston or Raleigh or Richardson
OnsiteFull Time
Bachelor's degree or equivalent experience; hands-on GenAI and Agentic AI development using orchestration frameworks, vector databases, cloud AI platforms, governance, evaluation, and deployment tools.
SAS, R, Python, LangChain, LangGraph, LlamaIndex, Semantic Kernel, AutoGen, CrewAI, Pinecone, Weaviate, Milvus, pgvector, FAISS, ChromaDB, Azure AI Search, Azure OpenAI, AWS Bedrock, Vertex AI, OpenAI, Anthropic, Gemini, Hugging Face, PyTorch, LoRA, QLoRA, PEFT, GitHub Actions, Jenkins, Terraform, Helm, Kubernetes, React, Angular, TypeScript, GraphQL, RDBMS, LLMs
1w
Save
Mark Applied
Hide
GenAI Engineer
Charlotte or Dallas or Houston or Raleigh or Richardson
OnsiteFull Time
Bachelor's degree or equivalent, or progressive experience in lieu of education. Requires GenAI, agentic AI, orchestration frameworks, vector databases, cloud AI platforms, governance, evaluation, and deployment expertise.
SAS, R, Python, LangChain, LangGraph, LlamaIndex, Semantic Kernel, AutoGen, CrewAI, Pinecone, Weaviate, Milvus, pgvector, FAISS, ChromaDB, Azure AI Search, Azure OpenAI, AWS Bedrock, Vertex AI, OpenAI, Anthropic, Gemini, Hugging Face, PyTorch, LoRA, QLoRA, PEFT, Llama, Mistral, Gemma, DeepSeek, Falcon, GitHub Actions, Jenkins, Terraform, Helm, Kubernetes, React, Angular, TypeScript, GraphQL
1w
Save
Mark Applied
Hide
GenAI Engineer
Charlotte or Dallas or Houston or Raleigh or Richardson
OnsiteFull Time
Bachelor's degree or equivalent, or progressive specialty experience in lieu of education. Requires enterprise GenAI and Agentic AI experience, orchestration frameworks, vector databases, cloud AI platforms, governance, evaluation, and deployment knowledge.
SAS, R, Python, LangChain, LangGraph, LlamaIndex, Semantic Kernel, AutoGen, CrewAI, Pinecone, Weaviate, Milvus, pgvector, FAISS, ChromaDB, Azure AI Search, Azure OpenAI, AWS Bedrock, Vertex AI, OpenAI, Anthropic, Gemini, Hugging Face, PyTorch, LoRA, QLoRA, PEFT, Llama, Mistral, Gemma, DeepSeek, Falcon, GitHub Actions, Jenkins, Terraform, Helm, Kubernetes, React, Angular, TypeScript, GraphQL
2mo
Save
Mark Applied
Hide
Content Automation and GenAI - Consulting and Delivery Manager
New York City or Milwaukee or Herndon or Dallas or Columbus or Kirkland or Irvine or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or Arlington or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or San Francisco or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$266k/yr OnsiteFull Time
7+ YOE7+ years client-facing consulting or digital transformation experience; hands-on experience evaluating/applying content automation or GenAI tools and delivering GenAI POCs; strong understanding of LLM concepts, prompt engineering, safety/responsible AI, content operations, and team leadership.
OpenAI, Google Gemini, M365 Copilot, Writer, FireFly, ChatGPT, Adobe Workfront, AEM, CMS, DAM, PIM