8 ai evaluation engineer jobs at 6 companies in Middletown, DE
2d
Save
Mark Applied
Hide
Lead AI Engineer | Onsite - Delaware
Wilmington, Delaware, United States
$56k-$196k/yr OnsiteContract
Photon: An information technology organization developing software and artificial intelligence solutions.
6+ YOE2+ MgmtRequires 6+ years of software engineering, 2+ years leading LLM/AI delivery, advanced Python, LLM integrations, RAG, AI agents, prompt engineering, evaluation, observability, and stakeholder communication.
Python, LangChain, LlamaIndex, Semantic Kernel, AWS Bedrock, MCP, CI/CD, LLM API, SDK, RAG
2d
Save
Mark Applied
Hide
AI Engineer
New York City or United States or Raleigh-Durham or Atlanta or Philadelphia
$150k-$300k/yr HybridFull Time
Production experience launching LLM or agent products, strong Python, agent frameworks, RAG, prompt engineering, evaluation systems, ML tools, orchestration workflows, and stakeholder communication.
Python, AWS, PyTorch, scikit-learn, SQL, Spark, Airflow, ZenML, Kedro, dbt
2mo
Save
Mark Applied
Hide
AI Engineer - Software Engineer III
Jersey City or Wilmington
$133k-$185k/yr OnsiteFull Time
3+ YOE3+ years software engineering experience; hands-on building and operating production LLM/agent applications, AWS cloud-native services, retrieval-augmented generation, API integrations, evaluation/observability, and responsible AI practices.
AWS, Kubernetes
3w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
1mo
Save
Mark Applied
Hide
AI Modeler
Malvern, Pennsylvania, United States
$130k-$160k/yr OnsiteFull Time
10+ YOE10+ years Python software engineering, hands-on Amazon Bedrock, prompt engineering, AWS fundamentals, model evaluation, and experience building observable production AI systems.
Python, Amazon Bedrock, AWS Lambda, S3, SQS, SNS, EventBridge, CloudWatch, IAM, Secrets Manager, AWS Textract, PyTorch, scikit-learn, PostgreSQL
1mo
Save
Mark Applied
Hide
Agentic AI Architect - Intelligence Engineering (East)
Atlanta or Boston or Charlotte or Hartford or Miami or New Brunswick or New York City or Philadelphia or Raleigh or Washington
$108k-$218k/yr HybridFull Time
5+ YOE5+ years software engineering experience with 2+ years on generative/agentic AI; experience designing multi-agent systems, RAG, cloud AI platforms, Python and API frameworks, evaluation and governance for production AI systems.
Amazon Web Services, Azure, Google Cloud, AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, Model Context Protocol (MCP), LangSmith, RAGAS, DeepEval, Claude Code, Cursor, Kiro, Python, FastAPI, Flask
2w
Save
Mark Applied
Hide
Senior Product Manager, AI & Data Science Products
Seattle or Richmond or Austin or North Charleston or Philadelphia or San Francisco or Denver or Miami or Atlanta or Chicago or Augusta or Boston or Las Vegas or Trenton or New York or Raleigh or Portland
RemoteFull Time
3+ YOERequires 3+ years of product management or comparable experience, customer-facing AI or data product ownership, applied AI/ML knowledge, data science and engineering collaboration, experimentation, analytics, and quality evaluation skills.
AI, machine learning, APIs, MCP
2mo
Save
Mark Applied
Hide
Content Automation and GenAI - Consulting and Delivery Manager
New York City or Milwaukee or Herndon or Dallas or Columbus or Kirkland or Irvine or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or Arlington or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or San Francisco or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$266k/yr OnsiteFull Time
7+ YOE7+ years client-facing consulting or digital transformation experience; hands-on experience evaluating/applying content automation or GenAI tools and delivering GenAI POCs; strong understanding of LLM concepts, prompt engineering, safety/responsible AI, content operations, and team leadership.
OpenAI, Google Gemini, M365 Copilot, Writer, FireFly, ChatGPT, Adobe Workfront, AEM, CMS, DAM, PIM