58 ai evaluation engineer jobs at 41 companies in Texas
2d
Save
Mark Applied
Hide
AI Evaluation Engineer (QA)
New York City or Austin or Miami or Dallas or Phoenix or São Paulo or Toronto
OnsiteFull Time, Contract
4+ YOEBachelor's degree in a technical field or equivalent experience, 4+ years in QA/test engineering, Python and data-science skills, LLM evaluation and statistical analysis experience, and automated test framework expertise.
Python, LLM evaluation frameworks, CI/CD, Test automation frameworks
6d
Save
Mark Applied
Hide
Senior Frontier AI Deployment Engineer
Austin or Texas or United States or Europe or Asia
RemoteFull Time
6+ YOERequires 6+ years in software, data, ML/AI, solutions engineering, or technical product delivery; generative AI delivery experience; cross-functional leadership; communication; architecture, evaluation, security, and production operations knowledge.
AWS, Amazon Bedrock, Amazon Bedrock AgentCore, CI/CD
2w
Save
Mark Applied
Hide
Senior AI Engineer
Austin, Texas, United States
HybridFull Time
8+ YOE8+ years of industry experience, strong Python and software engineering skills, production agentic AI experience, AI evaluation expertise, prompt/context engineering, security awareness, and strong stakeholder communication.
Python, MCP
3w
Save
Mark Applied
Hide
AI Engineer - TX
Texas, United States
OnsiteFull Time
5+ YOERequires 5+ years of AI/ML engineering experience evaluating, fine-tuning, and deploying LLMs, cloud infrastructure experience, RAG solutions, embedding models, vector databases, agentic workflows, and evaluation frameworks.
LLM, AWS, GCP, RAG, EvalOps, Evals-as-a-Service, embedding models, vector databases, LLM orchestration frameworks, multi-model pipelines
1w
Save
Mark Applied
Hide
AI Support Engineer
San Jose or Austin
$96k-$148k/yr OnsiteFull Time
Bachelor's degree in engineering, computer science, information systems, or equivalent; experience evaluating technical solutions; AI familiarity; analytical, troubleshooting, communication, and project leadership skills.
LLMs, RAG, AI agents, MCP
3mo
Save
Mark Applied
Hide
AI Engineer
Plano or Purchase or Chicago
$94k-$156k/yr OnsiteFull Time
6+ YOEBachelor in CS/AI/ML or equivalent; 6-8 years software lifecycle; ML/LLM/agent systems; Python/Java; production-grade AI delivery; strong evaluation and automation.
Python, Java, FastAPI, asyncio, Pydantic, LangChain, LangGraph, CrewAI, MLflow, Arise, Docker, Kubernetes, Ray, Kafka, gRPC, Redis, Prometheus, OpenTelemetry, Grafana
2w
Save
Mark Applied
Hide
Senior AI Engineer
Austin, Texas, United States
HybridFull Time
5+ YOEBachelor's degree in a relevant engineering or computer science field and 5+ years of relevant experience. Requires strong Python, AI/ML systems, reliable software design, evaluation, security, and cross-functional communication skills.
Python, C/C++, Linux, retrieval-augmented generation, vector search, CI/CD, RTOS
3w
Save
Mark Applied
Hide
AI Engineer
San Antonio, Texas, United States
$99k-$225k/yr OnsiteFull Time
3+ YOE3+ years developing production software in Python; bachelor's degree; TS/SCI clearance; DoD 8140 Level II certification; experience with AI agents, RAG, APIs, distributed systems, evaluation, and CI/CD.
Python, LangChain, LangGraph, AutoGen, MCP, A2A, ONNX, GGML, Ollama, ReAct, OAuth2, JWT, API Keys, Databricks, Snowflake
2mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York or San Francisco or McLean or Cambridge or San Jose or Plano
$209k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE +6 years or Master's +4 years; 6+ years programming with Python/Go/Scala/Java; experience deploying scalable AI on cloud; LLM, inference, similarity search, VectorDBs, guardrails, model evaluation, and optimization experience; leadership and research literacy.
Python, Go, Scala, Java, C++, C#, Golang, AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure
2w
Save
Mark Applied
Hide
Staff AI Platform Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York or Seattle or Toronto or Santa Barbara or San Diego
$180k-$273k/yr RemoteFull Time
7+ YOERequires 7+ years in AI/ML platform engineering, strong Python and/or TypeScript, distributed systems, APIs, evaluation, observability, and AI infrastructure experience; bachelor's degree or equivalent practical experience.
Python, TypeScript, JavaScript, React, Kubernetes, Docker, Terraform, LangChain, LangGraph, LlamaIndex, LiveKit, REST, gRPC, MCP, A2A
3w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
1mo
Save
Mark Applied
Hide
Senior AI Platform Engineer
San Francisco or Alabama or Arkansas or California or Colorado or Florida or Georgia or Illinois or Kentucky or Massachusetts or Michigan or Montana or Missouri or Nevada or New Jersey or New York or North Carolina or Oregon or Pennsylvania or Texas or Washington or Utah or Virginia or Wisconsin
$156k-$231k/yr HybridFull Time
3+ YOE3+ years building production software or ML/data systems; strong Python and systems/API design; experience with LLM retrieval/RAG, agents, evaluation, Databricks/MLflow and modern data stacks.
Python, PySpark, dbt, Databricks, Delta Lake, Unity Catalog, MLflow, Astronomer, Airflow, Claude, GitHub, Shortcut, Notion, pgvector, Pinecone, Weaviate, LangGraph, MCP
3w
Save
Mark Applied
Hide
AI / ML Engineer
United States or Brownsville or Madison or Boise or Lincoln or Centennial
$95k-$130k/yr HybridFull Time
2+ YOERequires 2+ years in AI, ML, or software engineering; Python, AWS, agentic LLM systems, evaluation, production deployment, RAG, CI/CD, and Terraform experience; bachelor's or master's degree preferred; U.S. citizenship and ability to obtain 6C clearance.
Python, AWS, Amazon Bedrock, AWS Lambda, Amazon ECS, AWS Fargate, Amazon S3, Amazon OpenSearch, AWS Step Functions, Terraform, Docker, Kubernetes, CI/CD, RAG
2w
Save
Mark Applied
Hide
Applied AI Engineer
Austin, Texas, United States
$160k-$200k/yr OnsiteFull Time
3+ YOERequires 3+ years building production backend or distributed systems, shipped AI/LLM systems, Python, a secondary language, cloud infrastructure, Docker, Kubernetes, and LLM integration and evaluation expertise.
Python, TypeScript, Go, Rust, AWS, GCP, Azure, Docker, Kubernetes, Model Context Protocol (MCP), LangGraph, CrewAI, Claude Agent SDK, Google ADK, OpenAI ADK, Langfuse, Arize, Braintrust, Weights & Biases
3mo
Save
Mark Applied
Hide
Solutions Engineer (AI Services)
New Braunfels, Texas, United States
$97k-$145k/yr RemoteFull Time
4+ YOERequires 4–7 years in data science or machine learning focused on LLM training and evaluation, technical sales experience with global enterprises, AI safety knowledge, and strong project management and communication skills.
Large Language Models (LLMs), Proof of Concept (POC), Statements of Work (SOWs)
2w
Save
Mark Applied
Hide
Full-stack AI Engineer
Austin, Texas, United States
HybridFull Time
3+ YOERequires 3+ years of software engineering experience, C#/.NET and TypeScript/React proficiency, production LLM experience, Azure and Bicep knowledge, API design, async patterns, and behavioral or regression evaluations.
C#, .NET, React, TypeScript, Microsoft Agent Framework, .NET Aspire, Azure OpenAI, Microsoft Azure, App Service, AKS, Azure Functions, Key Vault, API Management, Entra ID, Bicep, Snowflake, Databricks, Microsoft Fabric, AG-UI, CopilotKit, N8N, Semantic Kernel, AutoGen, Make, Zapier, Foundry Observability, Foundry Evals, Azure DevOps, MCP, A2A
1mo
Save
Mark Applied
Hide
Director, AI Engineering
Frisco, Texas, United States
OnsiteFull Time
Experience leading technical teams to build AI, software, or data products in regulated environments; practical knowledge of generative AI, LLMs, agents, RAG, evaluation, and enterprise AI risk; strong product judgment and stakeholder management.
AWS Bedrock, Microsoft Copilot Studio, LLM, RAG, APIs
2mo
Save
Mark Applied
Hide
Principal Developer, AI Networking
Santa Clara or Texas or Colorado or Washington
$272k-$489k/yr OnsiteFull Time
15+ YOEBSc in CS or equivalent; 15+ years in high-performance networking (RDMA, MPI, NCCL, SHARP); experience with CUDA, PyTorch/TensorFlow; proficiency in Python, Bash, C++; performance evaluation and container environments.
RDMA, MPI, NCCL, SHARP, CUDA, TensorFlow, PyTorch, Python, Bash, C++
1mo
Save
Mark Applied
Hide
Agentic AI Architect - Intelligence Engineering (Central)
Austin or Chicago or Columbus or Dallas or Detroit or Houston or Indianapolis or Kansas City or Minneapolis or Nashville or St. Louis
$108k-$200k/yr HybridFull Time
5+ YOE5+ years software engineering experience with 2+ years focused on generative/agentic AI; experience designing multi-agent systems, RAG, cloud AI platforms, Python, API frameworks, evaluation/observability, and leading small teams.
Amazon Web Services, Azure, Google Cloud, AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Python, FastAPI, Flask, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, LangSmith, RAGAS, DeepEval, Claude Code, Cursor, Kiro, AutoGen, CrewAI, Semantic Kernel, Model Context Protocol (MCP)
2mo
Save
Mark Applied
Hide
Full Stack AI Product Engineer (DataEdge)
Atlanta or Austin or Chicago or Dallas or Houston
$79k-$95k/yr HybridFull Time
3+ YOE3+ years building production full-stack software with TypeScript and Python; experience with production AI systems, agentic workflows, RAG, LangChain/LangGraph, containerization, and evaluation/regression gates.
TypeScript, Python, Node.js, LangGraph, LangChain, FastAPI, Pydantic v2, pytest, Docker, Kubernetes, Helm, Temporal, pgvector, OpenSearch, Express, Bun, Koa, Fastify, NestJS, tRPC, Zod, OpenAPI codegen, yarn, pnpm, npm, ESLint, Prettier, Vitest, Jest, Vite, Turbopack, esbuild, Cursor, GitHub Copilot
Explore Jobs
Expand Your Job Search
Top Cities in Texas for AI Evaluation Engineer
- AI Evaluation Engineer jobs in Houston, TX
- AI Evaluation Engineer jobs in San Antonio, TX
- AI Evaluation Engineer jobs in Dallas, TX
- AI Evaluation Engineer jobs in Austin, TX
- AI Evaluation Engineer jobs in Fort Worth, TX
- AI Evaluation Engineer jobs in El Paso, TX
- AI Evaluation Engineer jobs in Arlington, TX
- AI Evaluation Engineer jobs in Corpus Christi, TX
- AI Evaluation Engineer jobs in Plano, TX
- AI Evaluation Engineer jobs in Laredo, TX
- AI Evaluation Engineer jobs in Lubbock, TX
- AI Evaluation Engineer jobs in Garland, TX
- AI Evaluation Engineer jobs in Irving, TX
- AI Evaluation Engineer jobs in Amarillo, TX
- AI Evaluation Engineer jobs in Grand Prairie, TX
- AI Evaluation Engineer jobs in Brownsville, TX
- AI Evaluation Engineer jobs in McKinney, TX
- AI Evaluation Engineer jobs in Frisco, TX
- AI Evaluation Engineer jobs in Pasadena, TX
- AI Evaluation Engineer jobs in Mesquite, TX