26 ai evaluation engineer jobs at 20 companies in San Marcos, TX
2d
Save
Mark Applied
Hide
AI Evaluation Engineer (QA)
New York City or Austin or Miami or Dallas or Phoenix or São Paulo or Toronto
OnsiteFull Time, Contract
4+ YOEBachelor's degree in a technical field or equivalent experience, 4+ years in QA/test engineering, Python and data-science skills, LLM evaluation and statistical analysis experience, and automated test framework expertise.
Python, LLM evaluation frameworks, CI/CD, Test automation frameworks
6d
Save
Mark Applied
Hide
Senior Frontier AI Deployment Engineer
Austin or Texas or United States or Europe or Asia
RemoteFull Time
6+ YOERequires 6+ years in software, data, ML/AI, solutions engineering, or technical product delivery; generative AI delivery experience; cross-functional leadership; communication; architecture, evaluation, security, and production operations knowledge.
AWS, Amazon Bedrock, Amazon Bedrock AgentCore, CI/CD
3w
Save
Mark Applied
Hide
Senior AI Engineer
Austin, Texas, United States
HybridFull Time
8+ YOE8+ years of industry experience, strong Python and software engineering skills, production agentic AI experience, AI evaluation expertise, prompt/context engineering, security awareness, and strong stakeholder communication.
Python, MCP
1w
Save
Mark Applied
Hide
AI Support Engineer
San Jose or Austin
$96k-$148k/yr OnsiteFull Time
Bachelor's degree in engineering, computer science, information systems, or equivalent; experience evaluating technical solutions; AI familiarity; analytical, troubleshooting, communication, and project leadership skills.
LLMs, RAG, AI agents, MCP
2w
Save
Mark Applied
Hide
Senior AI Engineer
Austin, Texas, United States
HybridFull Time
5+ YOEBachelor's degree in a relevant engineering or computer science field and 5+ years of relevant experience. Requires strong Python, AI/ML systems, reliable software design, evaluation, security, and cross-functional communication skills.
Python, C/C++, Linux, retrieval-augmented generation, vector search, CI/CD, RTOS
3w
Save
Mark Applied
Hide
AI Engineer
San Antonio, Texas, United States
$99k-$225k/yr OnsiteFull Time
3+ YOE3+ years developing production software in Python; bachelor's degree; TS/SCI clearance; DoD 8140 Level II certification; experience with AI agents, RAG, APIs, distributed systems, evaluation, and CI/CD.
Python, LangChain, LangGraph, AutoGen, MCP, A2A, ONNX, GGML, Ollama, ReAct, OAuth2, JWT, API Keys, Databricks, Snowflake
2w
Save
Mark Applied
Hide
Staff AI Platform Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York or Seattle or Toronto or Santa Barbara or San Diego
$180k-$273k/yr RemoteFull Time
7+ YOERequires 7+ years in AI/ML platform engineering, strong Python and/or TypeScript, distributed systems, APIs, evaluation, observability, and AI infrastructure experience; bachelor's degree or equivalent practical experience.
Python, TypeScript, JavaScript, React, Kubernetes, Docker, Terraform, LangChain, LangGraph, LlamaIndex, LiveKit, REST, gRPC, MCP, A2A
3w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
2w
Save
Mark Applied
Hide
Applied AI Engineer
Austin, Texas, United States
$160k-$200k/yr OnsiteFull Time
3+ YOERequires 3+ years building production backend or distributed systems, shipped AI/LLM systems, Python, a secondary language, cloud infrastructure, Docker, Kubernetes, and LLM integration and evaluation expertise.
Python, TypeScript, Go, Rust, AWS, GCP, Azure, Docker, Kubernetes, Model Context Protocol (MCP), LangGraph, CrewAI, Claude Agent SDK, Google ADK, OpenAI ADK, Langfuse, Arize, Braintrust, Weights & Biases
3mo
Save
Mark Applied
Hide
Solutions Engineer (AI Services)
New Braunfels, Texas, United States
$97k-$145k/yr RemoteFull Time
4+ YOERequires 4–7 years in data science or machine learning focused on LLM training and evaluation, technical sales experience with global enterprises, AI safety knowledge, and strong project management and communication skills.
Large Language Models (LLMs), Proof of Concept (POC), Statements of Work (SOWs)
2w
Save
Mark Applied
Hide
Full-stack AI Engineer
Austin, Texas, United States
HybridFull Time
3+ YOERequires 3+ years of software engineering experience, C#/.NET and TypeScript/React proficiency, production LLM experience, Azure and Bicep knowledge, API design, async patterns, and behavioral or regression evaluations.
C#, .NET, React, TypeScript, Microsoft Agent Framework, .NET Aspire, Azure OpenAI, Microsoft Azure, App Service, AKS, Azure Functions, Key Vault, API Management, Entra ID, Bicep, Snowflake, Databricks, Microsoft Fabric, AG-UI, CopilotKit, N8N, Semantic Kernel, AutoGen, Make, Zapier, Foundry Observability, Foundry Evals, Azure DevOps, MCP, A2A
1mo
Save
Mark Applied
Hide
Agentic AI Architect - Intelligence Engineering (Central)
Austin or Chicago or Columbus or Dallas or Detroit or Houston or Indianapolis or Kansas City or Minneapolis or Nashville or St. Louis
$108k-$200k/yr HybridFull Time
5+ YOE5+ years software engineering experience with 2+ years focused on generative/agentic AI; experience designing multi-agent systems, RAG, cloud AI platforms, Python, API frameworks, evaluation/observability, and leading small teams.
Amazon Web Services, Azure, Google Cloud, AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Python, FastAPI, Flask, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, LangSmith, RAGAS, DeepEval, Claude Code, Cursor, Kiro, AutoGen, CrewAI, Semantic Kernel, Model Context Protocol (MCP)
2mo
Save
Mark Applied
Hide
Full Stack AI Product Engineer (DataEdge)
Atlanta or Austin or Chicago or Dallas or Houston
$79k-$95k/yr HybridFull Time
3+ YOE3+ years building production full-stack software with TypeScript and Python; experience with production AI systems, agentic workflows, RAG, LangChain/LangGraph, containerization, and evaluation/regression gates.
TypeScript, Python, Node.js, LangGraph, LangChain, FastAPI, Pydantic v2, pytest, Docker, Kubernetes, Helm, Temporal, pgvector, OpenSearch, Express, Bun, Koa, Fastify, NestJS, tRPC, Zod, OpenAPI codegen, yarn, pnpm, npm, ESLint, Prettier, Vitest, Jest, Vite, Turbopack, esbuild, Cursor, GitHub Copilot
3w
Save
Mark Applied
Hide
Application Software Engineer, Applied AI
Bastrop or Cape Canaveral or Hawthorne or McGregor or Redmond or Brownsville or Vandenberg
OnsiteFull Time
1+ YOEDesign, evaluate, deploy, and integrate AI systems including LLMs; 1+ years full-stack experience; bachelor's in CS/engineering/math or 2+ years professional software experience; strong software engineering and AI production experience.
Python, C#.NET, Go, Scala, Java, Docker, Kubernetes, Kafka, Angular, React, PostgreSQL, SQL Server, LLM
1d
Save
Mark Applied
Hide
Senior ML Systems Engineer - AI Evaluation Foundations
Sunnyvale or Washington or Austin or Mountain View or Warren
$145k-$261k/yr HybridFull Time
3+ YOERequires 3+ years of relevant industry experience, bachelor's degree or equivalent, strong communication, and experience with listed ML, frontend, backend, data, or infrastructure technologies.
Python, Node.js, React, TypeScript, WebGL, WebGPU, Streamlit, Jupyter notebooks, Spark, BigQuery, Kubernetes
1mo
Save
Mark Applied
Hide
Software Engineer, People Ops and AI Tools
Austin or San Francisco
OnsiteFull Time
Strong engineering background in TypeScript, Python, or Go; practical experience with LLMs, RAG, tool calling, and prompt evaluation; expertise in system integrations, identity, and event-driven workflows; strong privacy and security judgment.
TypeScript, Python, Go, LLMs, RAG, React, Drizzle, Zod, Postgres, Workers, Workflows, Access, Hyperdrive, R2, Workers AI, AI Gateway, Greenhouse, OAuth, webhook
1mo
Save
Mark Applied
Hide
AI Data Scientist – Enterprise AI
Spring or Austin or Houston
$131k-$205k/yr OnsiteFull Time
3+ YOE3+ years building AI/ML solutions; degree in CS/DS/ML/AI/Statistics/Engineering/Math; proficiency in Python, SQL, Spark/Databricks, and model evaluation; strong communication skills.
Python, SQL, Spark, Databricks, Azure, AWS, GCP, Github, Github Copilot, Large Language Models (LLMs), Generative AI
2w
Save
Mark Applied
Hide
Senior Product Manager, AI & Data Science Products
Seattle or Richmond or Austin or North Charleston or Philadelphia or San Francisco or Denver or Miami or Atlanta or Chicago or Augusta or Boston or Las Vegas or Trenton or New York or Raleigh or Portland
RemoteFull Time
3+ YOERequires 3+ years of product management or comparable experience, customer-facing AI or data product ownership, applied AI/ML knowledge, data science and engineering collaboration, experimentation, analytics, and quality evaluation skills.
AI, machine learning, APIs, MCP
3w
Save
Mark Applied
Hide
Head of AI Engineering at AIOS — Remote, $200-$400k/yr + equity
Austin or San Francisco or London or New York City or United States or United Kingdom
$200k-$400k/yr RemoteFull Time
8+ YOERequires 8+ years of software engineering, a technical bachelor's degree, production agent-building experience, systems expertise, evaluation design, safe consequential actions, model judgment, and small-team leadership.
AIOS Agent SDK, Macbook
1w
Save
Mark Applied
Hide
Manager, Sales Solutions Engineering
Austin, Texas, United States
OnsiteFull Time
Requires software development or developer tools experience, technical sales leadership, concurrent technical evaluation management, coaching ability, executive presence, operational discipline, and active AI workflow use.
Claude Code, Codex, Cursor, GitHub Copilot, Gemini, Devin, SonarQube, SonarQube Foundation Agent, SonarSweep, Sonar Context Augmentation, Salesforce, AI
Explore Jobs
Expand Your Job Search
Top Cities Near San Marcos for AI Evaluation Engineer
- AI Evaluation Engineer jobs in San Antonio, TX
- AI Evaluation Engineer jobs in Austin, TX
- AI Evaluation Engineer jobs in Round Rock, TX
- AI Evaluation Engineer jobs in New Braunfels, TX
- AI Evaluation Engineer jobs in Cedar Park, TX
- AI Evaluation Engineer jobs in Pflugerville, TX
- AI Evaluation Engineer jobs in Schertz, TX
- AI Evaluation Engineer jobs in Leander, TX
- AI Evaluation Engineer jobs in Kyle, TX
- AI Evaluation Engineer jobs in Cibolo, TX
- AI Evaluation Engineer jobs in Seguin, TX
- AI Evaluation Engineer jobs in Converse, TX
- AI Evaluation Engineer jobs in Universal City, TX
- AI Evaluation Engineer jobs in Live Oak, TX
- AI Evaluation Engineer jobs in Lakeway, TX
- AI Evaluation Engineer jobs in Buda, TX
- AI Evaluation Engineer jobs in Boerne, TX
- AI Evaluation Engineer jobs in Lockhart, TX
- AI Evaluation Engineer jobs in Leon Valley, TX
- AI Evaluation Engineer jobs in Selma, TX