22 ai evaluation engineer jobs at 17 companies in Rowlett, TX
2d
Save
Mark Applied
Hide
AI Evaluation Engineer (QA)
New York City or Austin or Miami or Dallas or Phoenix or São Paulo or Toronto
OnsiteFull Time, Contract
4+ YOEBachelor's degree in a technical field or equivalent experience, 4+ years in QA/test engineering, Python and data-science skills, LLM evaluation and statistical analysis experience, and automated test framework expertise.
Python, LLM evaluation frameworks, CI/CD, Test automation frameworks
3mo
Save
Mark Applied
Hide
AI Engineer
Plano or Purchase or Chicago
$94k-$156k/yr OnsiteFull Time
6+ YOEBachelor in CS/AI/ML or equivalent; 6-8 years software lifecycle; ML/LLM/agent systems; Python/Java; production-grade AI delivery; strong evaluation and automation.
Python, Java, FastAPI, asyncio, Pydantic, LangChain, LangGraph, CrewAI, MLflow, Arise, Docker, Kubernetes, Ray, Kafka, gRPC, Redis, Prometheus, OpenTelemetry, Grafana
2mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York or San Francisco or McLean or Cambridge or San Jose or Plano
$209k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE +6 years or Master's +4 years; 6+ years programming with Python/Go/Scala/Java; experience deploying scalable AI on cloud; LLM, inference, similarity search, VectorDBs, guardrails, model evaluation, and optimization experience; leadership and research literacy.
Python, Go, Scala, Java, C++, C#, Golang, AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure
3w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
1mo
Save
Mark Applied
Hide
Director, AI Engineering
Frisco, Texas, United States
OnsiteFull Time
Experience leading technical teams to build AI, software, or data products in regulated environments; practical knowledge of generative AI, LLMs, agents, RAG, evaluation, and enterprise AI risk; strong product judgment and stakeholder management.
AWS Bedrock, Microsoft Copilot Studio, LLM, RAG, APIs
1mo
Save
Mark Applied
Hide
Agentic AI Architect - Intelligence Engineering (Central)
Austin or Chicago or Columbus or Dallas or Detroit or Houston or Indianapolis or Kansas City or Minneapolis or Nashville or St. Louis
$108k-$200k/yr HybridFull Time
5+ YOE5+ years software engineering experience with 2+ years focused on generative/agentic AI; experience designing multi-agent systems, RAG, cloud AI platforms, Python, API frameworks, evaluation/observability, and leading small teams.
Amazon Web Services, Azure, Google Cloud, AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Python, FastAPI, Flask, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, LangSmith, RAGAS, DeepEval, Claude Code, Cursor, Kiro, AutoGen, CrewAI, Semantic Kernel, Model Context Protocol (MCP)
2mo
Save
Mark Applied
Hide
Full Stack AI Product Engineer (DataEdge)
Atlanta or Austin or Chicago or Dallas or Houston
$79k-$95k/yr HybridFull Time
3+ YOE3+ years building production full-stack software with TypeScript and Python; experience with production AI systems, agentic workflows, RAG, LangChain/LangGraph, containerization, and evaluation/regression gates.
TypeScript, Python, Node.js, LangGraph, LangChain, FastAPI, Pydantic v2, pytest, Docker, Kubernetes, Helm, Temporal, pgvector, OpenSearch, Express, Bun, Koa, Fastify, NestJS, tRPC, Zod, OpenAPI codegen, yarn, pnpm, npm, ESLint, Prettier, Vitest, Jest, Vite, Turbopack, esbuild, Cursor, GitHub Copilot
2mo
Save
Mark Applied
Hide
AI Tools Architect / Tech Lead
Spring or Fort Collins
$152k-$349k/yr HybridFull Time
10+ YOE10+ years software engineering; hands-on AI coding tools; technical leadership; CI/CD familiarity; strong communication; adaptable; AI model evaluation knowledge.
GitHub Copilot, ChatGPT, Claude, Python, CI/CD
3w
Save
Mark Applied
Hide
Technical Support Engineer - AI Lead
Redmond or Fargo or Las Colinas or Charlotte or San Francisco or New York City
$131k-$277k/yr HybridFull Time
10+ YOEBachelor's degree in computer science, IT, or related field and 10+ years of technical support, consulting, or IT experience; expertise in AI/ML, governance, evaluation, and executive stakeholder management.
AI, Responsible AI, LLM, agentic, AI/ML
1w
Save
Mark Applied
Hide
Senior Software Engineer - Agentic AI Engineer
Dallas or Atlanta or Chicago or Nashville
$73k-$174k/yr HybridFull Time
10+ YOE10+ years of related experience; advanced SQL and Python skills; experience with Vertex AI, Model Garden, Vertex AI Pipelines, model evaluation, BigQuery, Google Cloud Storage, and real-time data processing.
Vertex AI Agent Builder, Agent Developer Kit, Model Context Protocol (MCP) Toolbox, BigQuery, Spanner, Vertex AI, Dataflow, RunInference API, AlloyDB, Model Garden, Vertex AI Pipelines, SQL, Python, Google Cloud Storage
2w
Save
Mark Applied
Hide
GenAI Engineer
Charlotte or Dallas or Houston or Raleigh or Richardson
OnsiteFull Time
Bachelor's degree or equivalent experience; hands-on GenAI and Agentic AI development using orchestration frameworks, vector databases, cloud AI platforms, governance, evaluation, and deployment tools.
SAS, R, Python, LangChain, LangGraph, LlamaIndex, Semantic Kernel, AutoGen, CrewAI, Pinecone, Weaviate, Milvus, pgvector, FAISS, ChromaDB, Azure AI Search, Azure OpenAI, AWS Bedrock, Vertex AI, OpenAI, Anthropic, Gemini, Hugging Face, PyTorch, LoRA, QLoRA, PEFT, GitHub Actions, Jenkins, Terraform, Helm, Kubernetes, React, Angular, TypeScript, GraphQL, RDBMS, LLMs
1d
Save
Mark Applied
Hide
Senior Specialist - Data Sciences
Plano, Texas, United States
$81k-$145k/yr OnsiteFull Time
7+ YOERequires 7+ years of experience, strong Python and SQL, machine learning, NLP, statistics, prompt engineering, RAG, embeddings, model evaluation, and production AI deployment experience.
MySQL, Python, SQL, Pandas, Jupyter Notebook, Transformers, LangChain, LangGraph, LangSmith, Galileo, MongoDB, FastAPI, REST API, Git, Jenkins, OpenShift, Linux, Shell
2mo
Save
Mark Applied
Hide
Software Engineer III - AWS
Plano, Texas, United States
OnsiteFull Time
3+ YOE3+ years software engineering experience, proficiency with AWS data services, Python or Java, CI/CD, Terraform/IaC, and experience evaluating enterprise AI-assisted development tools; strong security and SDLC knowledge.
AWS, Glue, EMR, Athena, Redshift, Lake Formation, Python, Java, Terraform, CI/CD
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Legal — CoCounsel Forward Deployed Engineering
Frisco or New York City or Toronto or Ann Arbor or Eagan or San Francisco or Los Angeles or Irvine or McLean or Washington
$95k-$176k/yr HybridFull Time
5+ YOEJD or formal legal training (or equivalent experience),5+ years software engineering,proficiency in Python,AI/LLM evaluation and prompt engineering,ability to engage legal users and mentor engineers,experience delivering production-grade SaaS solutions.
Python
2d
Save
Mark Applied
Hide
Team Leader, Engineering — AI Enablement and Developer Tooling
Detroit or Cypress Waters
OnsiteFull Time
Engineering leadership experience managing technical teams, hands-on coding ability, and depth in distributed systems, cloud infrastructure, or software delivery. Requires practical production AI knowledge including LLMs, RAG, agents, APIs, evaluation, governance, and cost.
LLMs, RAG, model APIs
1mo
Save
Mark Applied
Hide
Learning Partner- Technical Development
Sunnyvale or Dallas
$115k-$153k/yr OnsiteFull Time
5+ YOE5+ years in instructional design or L&D with technical program design experience for engineering/AI audiences; stakeholder partnership, advanced evaluation skills, and familiarity with LMS/authoring and virtual facilitation tools.
LMS platforms, Articulate, Rise, virtual facilitation platforms, AI tools
3mo
Save
Mark Applied
Hide
POSTDOCTORAL RESEARCHER - Neurology - Lusk Lab [Req#: 947313, Position#: 116357]
Dallas, Texas, United States
OnsiteFull Time
Develop and evaluate LLM and agentic AI for extracting and structuring EHR data; skills in machine learning, NLP, prompt engineering, Python, R, and experience with large healthcare data environments required; CV required.
Python, R, EHR, LLM
2mo
Save
Mark Applied
Hide
Content Automation and GenAI - Consulting and Delivery Manager
New York City or Milwaukee or Herndon or Dallas or Columbus or Kirkland or Irvine or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or Arlington or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or San Francisco or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$266k/yr OnsiteFull Time
7+ YOE7+ years client-facing consulting or digital transformation experience; hands-on experience evaluating/applying content automation or GenAI tools and delivering GenAI POCs; strong understanding of LLM concepts, prompt engineering, safety/responsible AI, content operations, and team leadership.
OpenAI, Google Gemini, M365 Copilot, Writer, FireFly, ChatGPT, Adobe Workfront, AEM, CMS, DAM, PIM
Explore Jobs
Expand Your Job Search
Top Cities Near Rowlett for AI Evaluation Engineer
- AI Evaluation Engineer jobs in Dallas, TX
- AI Evaluation Engineer jobs in Fort Worth, TX
- AI Evaluation Engineer jobs in Arlington, TX
- AI Evaluation Engineer jobs in Plano, TX
- AI Evaluation Engineer jobs in Garland, TX
- AI Evaluation Engineer jobs in Irving, TX
- AI Evaluation Engineer jobs in Grand Prairie, TX
- AI Evaluation Engineer jobs in McKinney, TX
- AI Evaluation Engineer jobs in Frisco, TX
- AI Evaluation Engineer jobs in Mesquite, TX
- AI Evaluation Engineer jobs in Carrollton, TX
- AI Evaluation Engineer jobs in Denton, TX
- AI Evaluation Engineer jobs in Richardson, TX
- AI Evaluation Engineer jobs in Lewisville, TX
- AI Evaluation Engineer jobs in Allen, TX
- AI Evaluation Engineer jobs in Flower Mound, TX
- AI Evaluation Engineer jobs in North Richland Hills, TX
- AI Evaluation Engineer jobs in Mansfield, TX
- AI Evaluation Engineer jobs in Euless, TX
- AI Evaluation Engineer jobs in DeSoto, TX