23 ai evaluation engineer jobs at 18 companies in New Braunfels, TX
4d
Save
Mark Applied
Hide
4d
AI Evaluation Engineer (QA)
New York City or Austin or Miami or Dallas or Phoenix or São Paulo or Toronto
OnsiteFull Time, Contract
Appnovation: Full-service digital consultancy serving organizations through digital strategy, design, development, and support.
4+ YOEBachelor's degree in a technical field or equivalent experience, 4+ years in QA/test engineering, Python and data-science skills, LLM evaluation and statistical analysis experience, and automated test framework expertise.
Python, LLM evaluation frameworks, CI/CD, Test automation frameworks
TeamViewerFrankfurt Stock Exchange: TMV: Global technology providing remote connectivity and digital workplace solutions.
8+ YOE8+ years of industry experience, strong Python and software engineering skills, production agentic AI experience, AI evaluation expertise, prompt/context engineering, security awareness, and strong stakeholder communication.
Austin or Texas or United States or Europe or Asia
RemoteFull Time
Centric Software: AI-driven product concept-to-commercialization solutions for retailers, brands, and manufacturers.
6+ YOERequires 6+ years in software, data, ML/AI, solutions engineering, or technical product delivery; generative AI delivery experience; cross-functional leadership; communication; architecture, evaluation, security, and production operations knowledge.
Cirrus LogicNASDAQ: CRUS: Public fabless semiconductor supplying mixed-signal audio, haptics, camera, power, and sensing chips for mobile devices.
5+ YOEBachelor's degree in a relevant engineering or computer science field and 5+ years of relevant experience. Requires strong Python, AI/ML systems, reliable software design, evaluation, security, and cross-functional communication skills.
Booz Allen HamiltonNYSE: BAH: Global firm providing management, technology, and engineering consulting services.
3+ YOE3+ years developing production software in Python; bachelor's degree; TS/SCI clearance; DoD 8140 Level II certification; experience with AI agents, RAG, APIs, distributed systems, evaluation, and CI/CD.
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yrOnsiteFull Time
AccentureNYSE: ACN: Global professional services delivering 360° value.
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Tata Consultancy ServicesBSE: 532540: Global leader in IT services, consulting, and business solutions.
3+ YOERequires 3+ years building production backend or distributed systems, shipped AI/LLM systems, Python, a secondary language, cloud infrastructure, Docker, Kubernetes, and LLM integration and evaluation expertise.
Python, TypeScript, Go, Rust, AWS, GCP, Azure, Docker, Kubernetes, Model Context Protocol (MCP), LangGraph, CrewAI, Claude Agent SDK, Google ADK, OpenAI ADK, Langfuse, Arize, Braintrust, Weights & Biases
TaskUsNASDAQ: TASK: Provider of outsourced digital services and customer experience solutions.
4+ YOERequires 4–7 years in data science or machine learning focused on LLM training and evaluation, technical sales experience with global enterprises, AI safety knowledge, and strong project management and communication skills.
Large Language Models (LLMs), Proof of Concept (POC), Statements of Work (SOWs)
Light & WonderAustralian Securities Exchange: LNW: Public global games supplying casino hardware, systems, digital games, and charitable gaming to operators and players.
3+ YOERequires 3+ years of software engineering experience, C#/.NET and TypeScript/React proficiency, production LLM experience, Azure and Bicep knowledge, API design, async patterns, and behavioral or regression evaluations.
Agentic AI Architect - Intelligence Engineering (Central)
Austin or Chicago or Columbus or Dallas or Detroit or Houston or Indianapolis or Kansas City or Minneapolis or Nashville or St. Louis
$108k-$200k/yrHybridFull Time
Slalom: Business and technology consulting firm.
5+ YOE5+ years software engineering experience with 2+ years focused on generative/agentic AI; experience designing multi-agent systems, RAG, cloud AI platforms, Python, API frameworks, evaluation/observability, and leading small teams.
Amazon Web Services, Azure, Google Cloud, AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Python, FastAPI, Flask, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, LangSmith, RAGAS, DeepEval, Claude Code, Cursor, Kiro, AutoGen, CrewAI, Semantic Kernel, Model Context Protocol (MCP)
Senior ML Systems Engineer - AI Evaluation Foundations
Sunnyvale or Washington or Austin or Mountain View or Warren
$145k-$261k/yrHybridFull Time
General MotorsNYSE: GM: Designing, building, and selling the world's best vehicles.
3+ YOERequires 3+ years of relevant industry experience, bachelor's degree or equivalent, strong communication, and experience with listed ML, frontend, backend, data, or infrastructure technologies.
CloudflareNYSE: NET: Cloud-based security, performance, and reliability services for Internet applications.
Strong engineering background in TypeScript, Python, or Go; practical experience with LLMs, RAG, tool calling, and prompt evaluation; expertise in system integrations, identity, and event-driven workflows; strong privacy and security judgment.
HP Inc.NYSE: HPQ: Global leader in personal computing, printing, and technology solutions.
3+ YOE3+ years building AI/ML solutions; degree in CS/DS/ML/AI/Statistics/Engineering/Math; proficiency in Python, SQL, Spark/Databricks, and model evaluation; strong communication skills.
Python, SQL, Spark, Databricks, Azure, AWS, GCP, Github, Github Copilot, Large Language Models (LLMs), Generative AI
Atlanta or Austin or Dallas or Las Vegas or Nashville or Seattle or Cambridge or Detroit or San Diego or Denver
$150k-$215k/yrRemoteFull Time
LangChain: Private AI software providing agent-engineering platforms and open-source frameworks for developers and enterprises.
4+ YOERequires 4+ years of software engineering experience, deep Python expertise, 2+ years building production agent systems, client-facing communication skills, and experience with agent frameworks and AI evaluation.
Python, TypeScript, JavaScript, LangChain, LangGraph, Deep Agents, Axolotl, Unsloth, Hugging Face transformers, TRL, SFT, DPO, RLHF
Senior Product Manager, AI & Data Science Products
Seattle or Richmond or Austin or North Charleston or Philadelphia or San Francisco or Denver or Miami or Atlanta or Chicago or Augusta or Boston or Las Vegas or Trenton or New York or Raleigh or Portland
RemoteFull Time
Crunchbase: Provides predictive intelligence on private companies to investors, dealmakers, and analysts.
3+ YOERequires 3+ years of product management or comparable experience, customer-facing AI or data product ownership, applied AI/ML knowledge, data science and engineering collaboration, experimentation, analytics, and quality evaluation skills.
Head of AI Engineering at AIOS — Remote, $200-$400k/yr + equity
Austin or San Francisco or London or New York City or United States or United Kingdom
$200k-$400k/yrRemoteFull Time
AIOS: Private healthcare technology building AI-powered clinical infrastructure and direct-to-patient weight-management services for consumers.
8+ YOERequires 8+ years of software engineering, a technical bachelor's degree, production agent-building experience, systems expertise, evaluation design, safe consequential actions, model judgment, and small-team leadership.
SonarSource: Sonar analyzes code for quality and security.
Requires software development or developer tools experience, technical sales leadership, concurrent technical evaluation management, coaching ability, executive presence, operational discipline, and active AI workflow use.
Claude Code, Codex, Cursor, GitHub Copilot, Gemini, Devin, SonarQube, SonarQube Foundation Agent, SonarSweep, Sonar Context Augmentation, Salesforce, AI
Content Automation and GenAI - Consulting and Delivery Manager
New York City or Milwaukee or Herndon or Dallas or Columbus or Kirkland or Irvine or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or Arlington or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or San Francisco or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$266k/yrOnsiteFull Time
AccentureNYSE: ACN: Global professional services delivering 360° value.
7+ YOE7+ years client-facing consulting or digital transformation experience; hands-on experience evaluating/applying content automation or GenAI tools and delivering GenAI POCs; strong understanding of LLM concepts, prompt engineering, safety/responsible AI, content operations, and team leadership.