15 software engineering evaluator jobs at 14 companies in Aurora, IL
18h
Save
Mark Applied
Hide
JavaScript Developer
United States or Chicago or San Francisco
$200-$300/hr RemoteContract
3+ YOERequires 3+ years of software engineering experience, systems, infrastructure, or backend expertise, production software experience, and strong architecture, debugging, code review, and communication skills.
Python, C, C++, Rust, Go, Java, JavaScript, ReactJS
2mo
Save
Mark Applied
Hide
Senior Software Engineer, Agentic Systems
Chicago or United States
$169k-$208k/yr RemoteFull Time
5+ YOE5+ years building production software with strong Python; hands-on experience building LLM-powered agents, prompt/context engineering, production LLM reliability, evaluation harnesses, testing and observability.
Python, LLM, AWS Bedrock, Neo4j, NodeZero
2w
Save
Mark Applied
Hide
Senior Software Engineer, AI/ML
Chicago, Illinois, United States
$72k-$141k/yr HybridFull Time
4+ YOERequires a bachelor's degree or equivalent experience, 4+ years of application development, advanced Python, AI/ML, LLMs, Vertex AI, agent frameworks, prompt engineering, and model evaluation experience.
Python, Google Vertex AI, Gemini, OpenAI, Google Agent Development Kit, LangChain, LangGraph, LangSmith, LangFuse, Phoenix, Arize, Eval AI Testing
1mo
Save
Mark Applied
Hide
Sr. Software Engineer I, Evaluation Services
Chicago or California or Colorado or Florida or Georgia or Illinois or Indiana or Minnesota or Missouri or Montana or New Jersey or New York or North Carolina or Ohio or Oregon or Pennsylvania or South Carolina or Texas or Utah or Vermont or Virginia or Washington or Wisconsin or District of Columbia
$125k-$175k/yr HybridFull Time
5+ YOE5+ years software engineering with API development and partner integrations; strong REST/WebSocket/JSON/OAuth skills; proficiency in TypeScript/JavaScript or Python; excellent troubleshooting and communication.
REST APIs, WebSockets, JSON, OAuth, Postman, curl, browser developer tools, network analyzers, TypeScript, JavaScript, Python, React, Node.js, Swagger/OpenAPI, ReadMe
1w
Save
Mark Applied
Hide
Senior Software Engineer - Agentic AI Engineer
Dallas or Atlanta or Chicago or Nashville
$73k-$174k/yr HybridFull Time
10+ YOE10+ years of related experience; advanced SQL and Python skills; experience with Vertex AI, Model Garden, Vertex AI Pipelines, model evaluation, BigQuery, Google Cloud Storage, and real-time data processing.
Vertex AI Agent Builder, Agent Developer Kit, Model Context Protocol (MCP) Toolbox, BigQuery, Spanner, Vertex AI, Dataflow, RunInference API, AlloyDB, Model Garden, Vertex AI Pipelines, SQL, Python, Google Cloud Storage
1d
Save
Mark Applied
Hide
Sr. Software Engineer I, Evaluation Services (Scala)
Chicago or California or Colorado or Florida or Georgia or Illinois or Indiana or Minnesota or Missouri or Montana or New Jersey or New York or North Carolina or Ohio or Oregon or Pennsylvania or South Carolina or Texas or Utah or Vermont or Virginia or Washington or Wisconsin
$125k-$175k/yr HybridFull Time
5+ YOE5+ years of backend engineering experience with real-time, concurrent, highly available systems; strong Scala, Akka or equivalent, PostgreSQL, event-driven architecture, troubleshooting, technical specification, testing, and communication skills.
Scala, Akka, Pekko, ScalaTest, PostgreSQL, JSONB, Protobuf, SQL, Kafka, Pub/Sub, gRPC, Rust, Go, Datadog, GCP
1mo
Save
Mark Applied
Hide
Agentic AI Architect - Intelligence Engineering (Central)
Austin or Chicago or Columbus or Dallas or Detroit or Houston or Indianapolis or Kansas City or Minneapolis or Nashville or St. Louis
$108k-$200k/yr HybridFull Time
5+ YOE5+ years software engineering experience with 2+ years focused on generative/agentic AI; experience designing multi-agent systems, RAG, cloud AI platforms, Python, API frameworks, evaluation/observability, and leading small teams.
Amazon Web Services, Azure, Google Cloud, AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Python, FastAPI, Flask, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, LangSmith, RAGAS, DeepEval, Claude Code, Cursor, Kiro, AutoGen, CrewAI, Semantic Kernel, Model Context Protocol (MCP)
2mo
Save
Mark Applied
Hide
AI Evaluation Engineer
Bucharest or Boulder or Boston or Chicago or Glendora or Richmond or London or Auckland
lei16k-lei19k/mo HybridFull Time
5+ YOEBachelor's in CS/Data/Math, 5+ years software engineering with focus on testing/evaluation or AI/ML tooling, strong Python, experience building evaluation pipelines and LLM eval concepts, familiarity with RAG and production data pipelines.
RAGAS, LangSmith, PromptFlow, Snowflake, Python, RAG
4w
Save
Mark Applied
Hide
Senior Forensic Structural Engineer
Chicago, Illinois, United States
RemoteFull Time
5+ YOELicensed Structural Engineer in Illinois with 5+ years in structural analysis, failure evaluation, field investigations, report writing; BS in relevant engineering; physical ability for fieldwork; familiarity with Microsoft Office, CADD, and structural analysis software.
Microsoft Office suite, structural analysis software, CADD software
3w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
1mo
Save
Mark Applied
Hide
Senior AI Engineer
Chicago or Hong Kong or London or New York City or Singapore
$200k-$300k/yr OnsiteFull Time
5+ YOE5+ years software engineering with strong Python; production fine-tuning/distillation of open-weight models; on-prem LLM serving, GPU infrastructure and Kubernetes experience; model evaluation and tooling.
Python, Llama, Qwen, Mistral, vLLM, TGI, Triton, Kubernetes, Hugging Face
3mo
Save
Mark Applied
Hide
AI Engineer
Plano or Purchase or Chicago
$94k-$156k/yr OnsiteFull Time
6+ YOEBachelor in CS/AI/ML or equivalent; 6-8 years software lifecycle; ML/LLM/agent systems; Python/Java; production-grade AI delivery; strong evaluation and automation.
Python, Java, FastAPI, asyncio, Pydantic, LangChain, LangGraph, CrewAI, MLflow, Arise, Docker, Kubernetes, Ray, Kafka, gRPC, Redis, Prometheus, OpenTelemetry, Grafana
2mo
Save
Mark Applied
Hide
Full Stack AI Product Engineer (DataEdge)
Atlanta or Austin or Chicago or Dallas or Houston
$79k-$95k/yr HybridFull Time
3+ YOE3+ years building production full-stack software with TypeScript and Python; experience with production AI systems, agentic workflows, RAG, LangChain/LangGraph, containerization, and evaluation/regression gates.
TypeScript, Python, Node.js, LangGraph, LangChain, FastAPI, Pydantic v2, pytest, Docker, Kubernetes, Helm, Temporal, pgvector, OpenSearch, Express, Bun, Koa, Fastify, NestJS, tRPC, Zod, OpenAPI codegen, yarn, pnpm, npm, ESLint, Prettier, Vitest, Jest, Vite, Turbopack, esbuild, Cursor, GitHub Copilot
2w
Save
Mark Applied
Hide
Staff AI Platform Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York or Seattle or Toronto or Santa Barbara or San Diego
$180k-$273k/yr RemoteFull Time
7+ YOERequires 7+ years in AI/ML platform engineering, strong Python and/or TypeScript, distributed systems, APIs, evaluation, observability, and AI infrastructure experience; bachelor's degree or equivalent practical experience.
Python, TypeScript, JavaScript, React, Kubernetes, Docker, Terraform, LangChain, LangGraph, LlamaIndex, LiveKit, REST, gRPC, MCP, A2A
2mo
Save
Mark Applied
Hide
Senior Lead Architect – Commercial Card Payments Technology
Chicago, Illinois, United States
$147k-$225k/yr OnsiteFull Time
5+ YOE5+ years applied software engineering experience with system design, application development, testing, cloud-native solutions, proficiency in one or more programming languages/platforms, and experience evaluating AI‑augmented development tools; strong communication and mentoring skills.
Explore Jobs
Expand Your Job Search
Top Cities Near Aurora for Software Engineering Evaluator
- Software Engineering Evaluator jobs in Chicago, IL
- Software Engineering Evaluator jobs in Joliet, IL
- Software Engineering Evaluator jobs in Naperville, IL
- Software Engineering Evaluator jobs in Elgin, IL
- Software Engineering Evaluator jobs in Waukegan, IL
- Software Engineering Evaluator jobs in Cicero, IL
- Software Engineering Evaluator jobs in Hammond, IN
- Software Engineering Evaluator jobs in Arlington Heights, IL
- Software Engineering Evaluator jobs in Evanston, IL
- Software Engineering Evaluator jobs in Schaumburg, IL
- Software Engineering Evaluator jobs in Bolingbrook, IL
- Software Engineering Evaluator jobs in Palatine, IL
- Software Engineering Evaluator jobs in Skokie, IL
- Software Engineering Evaluator jobs in Des Plaines, IL
- Software Engineering Evaluator jobs in Orland Park, IL
- Software Engineering Evaluator jobs in Tinley Park, IL
- Software Engineering Evaluator jobs in Oak Lawn, IL
- Software Engineering Evaluator jobs in Berwyn, IL
- Software Engineering Evaluator jobs in Mount Prospect, IL
- Software Engineering Evaluator jobs in Wheaton, IL