39 software engineering evaluator jobs at 22 companies in Olympia, WA
3mo
Save
Mark Applied
Hide
Backend Software Engineer - Saga
New York or Seattle or Arlington or Rosslyn
OnsiteFull Time
4+ YOE4+ years backend software engineering; experience with GenAI systems, vector databases, LLM integrations, and evaluation harnesses; strong problem solving and ownership.
GenAI, vector databases, LLM integrations, RAG architectures, tool-call frameworks, production-grade software
1w
Save
Mark Applied
Hide
Software Engineer, Search and RAG Applications
Seattle, Washington, United States
OnsiteFull Time
Software engineering role developing real-time search, information retrieval, query understanding, document ranking, machine learning systems, data generation, and evaluation.
Siri, Spotlight, Safari, Lookup, Messages
3w
Save
Mark Applied
Hide
Software Engineer, Machine Learning Infrastructure - Generative AI
San Francisco or Sunnyvale or Seattle
$137k-$299k/yr OnsiteFull Time
3+ YOEBachelor's, master's, or doctoral degree in computer science or equivalent; 3+ years of software engineering experience; Python, distributed systems, production infrastructure, and LLM evaluation or observability experience.
Python, OpenTelemetry, SQL, Kubernetes, AWS, GCP, RAG, MCP, Claude Code, Codex, Cursor, Gem, Covey
3mo
Save
Mark Applied
Hide
Core-Platform Software Engineer
Carlsbad or Tempe or Englewood or Seattle
$141k-$222k/yr OnsiteFull Time
5+ YOEBachelor’s or Master’s in CS/CE; 5+ years embedded software in C/C++/Rust/Go/Bash/Python; OO design; CI/CD; DevOps; software quality; architecture evaluation; testing.
C, C++, Rust, Go, Bash, Python, Linux, CI/CD, GitHub Actions, Artifactory, Vault
2w
Save
Mark Applied
Hide
Software Engineer, Applied AI
San Francisco or Los Angeles or Washington or San Diego or Seattle or London
$150k-$170k/yr HybridFull Time
2+ YOEBS/MS in a technical field, 2+ years of software development, strong Python, production systems, AI/ML integration, model evaluation, and familiarity with APIs, distributed systems, containers, CI/CD, observability, and edge deployment.
Python, APIs, CI/CD, GPU
2w
Save
Mark Applied
Hide
Sr. Software Dev Engineer, SageMaker AI
Seattle, Washington, United States
$168k-$227k/yr OnsiteFull Time
5+ YOERequires 5+ years of professional software development, programming, system design or architecture, and engineering leadership or mentoring experience. Preferred: bachelor's degree, ML pipelines, data processing, evaluation infrastructure, and LLM experience.
Large Language Models (LLMs)
3w
Save
Mark Applied
Hide
Senior Software Development Engineer- Scout Team
Seattle, Washington, United States
$180k-$225k/yr OnsiteFull Time
5+ YOEBS in Computer Science or equivalent experience,5+ years professional software engineering,backend development with Java or Golang,CI/CD experience,ability to evaluate AI-generated code and lead technical strategy.
Java, Golang, Jenkins, GitLab, CI/CD, WhatsApp
3w
Save
Mark Applied
Hide
Staff Frontier Agents Engineer (Applied AI)
San Francisco or Seattle or New York City
$252k-$315k/yr OnsiteFull Time
8+ YOE8+ years applied AI or software engineering experience, strong Python skills, production LLM/agent experience, quantitative evaluation expertise, and excellent communication for enterprise customers.
Python, OpenAI, Claude, MCP, Docker, Kubernetes, AWS, Azure, GCP, CI/CD
3w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
2d
Save
Mark Applied
Hide
Senior AI Platform Engineer, Microsoft 365 & Copilot (3 year LTE)
Seattle or Washington
$157k/yr OnsiteFull Time, Temporary
10+ YOE10+ years in AI, software, cloud, platform, Microsoft 365, or Power Platform engineering; enterprise AI experience; Microsoft cloud expertise; secure data access, governance, evaluation, and operational experience.
Microsoft 365, Microsoft Copilot, Copilot Studio, Power Platform, SharePoint, Microsoft Teams, OneDrive, Exchange, Viva, Anthropic Claude, OpenAI ChatGPT, Power Apps, Power Automate, Dataverse, Azure AI, Azure OpenAI, Microsoft Graph, Entra ID, PowerShell, Semantic Kernel, Azure AI Search, Microsoft Excel, APIs
1mo
Save
Mark Applied
Hide
Staff Machine Learning Engineer - AI Cloud
San Francisco or New York or Seattle
$198k-$330k/yr OnsiteFull Time
8+ YOE8+ years software engineering experience with 5+ years focused on ML; deep expertise in LLMs and modern ML; hands-on with PyTorch and JAX; experience shipping ML systems and building evaluation/production infrastructure.
PyTorch, JAX, Slack, Microsoft 365
1mo
Save
Mark Applied
Hide
Agentic AI Engineer
Seattle, Washington, United States
$130k-$170k/yr HybridFull Time
3+ YOE3+ years software engineering experience, 1+ year shipping LLM/AI applications, hands-on with AWS AI services (Bedrock, Strands, AgentCore, SageMaker), strong Python/TypeScript skills, prompt engineering, evaluation, and responsible AI practices.
Strands Agents, AgentCore, Bedrock, Lambda, SageMaker, Python, TypeScript, IAM, DataDog, GitHub CI/CD
2w
Save
Mark Applied
Hide
Forward Deployed Engineer (FDE), Healthcare - Seattle
Seattle or Paris
$198k-$294k/yr HybridFull Time
6+ YOERequires 6+ years of software, ML/AI, solutions, or comparable engineering experience; hands-on ownership of complex deployments; healthcare workflows; and expertise in AI evaluation, privacy, security, governance, and reliability.
Machine Learning (ML), Artificial Intelligence (AI), Enterprise APIs, Electronic Health Records (EHR), Claims systems, Epic, HL7, FHIR, Oracle Health, Cerner, MEDITECH
6d
Save
Mark Applied
Hide
Member of Technical Staff - ML Operations
Toronto or Zürich or Seattle or California
HybridFull Time
Bachelor's degree or equivalent experience; strong Python and software engineering skills; CI/CD experience; multi-node training operations; reproducible pipelines; rigorous evaluation and incident response expertise.
Python, Hydra, OmegaConf, Weights & Biases, MLflow, PyTorch DCP, Slurm, Argo Workflows, GitHub Actions, Buildkite, Flyte, Ray, Prometheus, Grafana, OpenTelemetry
1w
Save
Mark Applied
Hide
Staff Machine Learning Engineer, Causal Inference
San Francisco or Sunnyvale or Los Angeles or Seattle or New York City
$204k-$299k/yr OnsiteFull Time
Deep causal inference, econometrics, experimentation, or causal ML experience; production ML engineering; rigorous model evaluation; and ability to collaborate across engineering, analytics, product, and business teams.
ML, CUPED, Covey, Covey Scout for Inbound
2w
Save
Mark Applied
Hide
Agent Evaluation & Evolution Machine Learning Engineer Graduate (AML-Ark-US) - 2027 Start
Seattle, Washington, United States
OnsiteFull Time
Bachelor's or master's degree in a relevant field, machine learning and deep learning foundations, hands-on LLM system experience, strong Python skills, ML or agent evaluation framework experience, and demonstrated research or engineering ability.
Python, Large Language Model (LLM), Model-as-a-Service (MaaS)
12h
Save
Mark Applied
Hide
AI Engineer, GTM Claudification
San Francisco or Seattle
$320k-$405k/yr HybridFull Time
8+ YOEProduction engineering experience with Python or TypeScript, LLMs, agents, MCP, evaluations, SQL, and data-driven systems; 8+ years preferred. Bachelor's degree or equivalent experience required.
Python, TypeScript, SQL, MCP, Claude Code, Claude Agent SDK, CRM
2mo
Save
Mark Applied
Hide
MANAGER - TEST & EVALUATION
Seattle or Moses Lake or Japan or Canada or Europe or United States
$160k-$220k/yr OnsiteFull Time
10+ YOE3+ MgmtBachelor's in engineering, 10+ years T&E experience (flight and ground), 3+ years leading technical teams, FAA Part 23/25 certification experience, flight test safety monitoring, EVM experience, and software/test systems familiarity.
Microsoft Office, Earned Value Management (EVM)
2w
Save
Mark Applied
Hide
Staff AI Platform Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York or Seattle or Toronto or Santa Barbara or San Diego
$180k-$273k/yr RemoteFull Time
7+ YOERequires 7+ years in AI/ML platform engineering, strong Python and/or TypeScript, distributed systems, APIs, evaluation, observability, and AI infrastructure experience; bachelor's degree or equivalent practical experience.
Python, TypeScript, JavaScript, React, Kubernetes, Docker, Terraform, LangChain, LangGraph, LlamaIndex, LiveKit, REST, gRPC, MCP, A2A
1mo
Save
Mark Applied
Hide
Machine Learning Engineer
Austin or New York or San Francisco or Seattle
$269k-$317k/yr OnsiteFull Time
Experience shipping ML/LLM features to production, evaluation harnesses, LLM APIs/fine-tuning/retrieval experience, production-quality code, strong communication and problem framing skills.
LLM APIs, Temporal
Explore Jobs
Expand Your Job Search
Top Cities Near Olympia for Software Engineering Evaluator
- Software Engineering Evaluator jobs in Seattle, WA
- Software Engineering Evaluator jobs in Tacoma, WA
- Software Engineering Evaluator jobs in Kent, WA
- Software Engineering Evaluator jobs in Renton, WA
- Software Engineering Evaluator jobs in Federal Way, WA
- Software Engineering Evaluator jobs in Auburn, WA
- Software Engineering Evaluator jobs in Lakewood, WA
- Software Engineering Evaluator jobs in Burien, WA
- Software Engineering Evaluator jobs in Lacey, WA
- Software Engineering Evaluator jobs in Puyallup, WA
- Software Engineering Evaluator jobs in Bremerton, WA
- Software Engineering Evaluator jobs in University Place, WA
- Software Engineering Evaluator jobs in Des Moines, WA
- Software Engineering Evaluator jobs in SeaTac, WA
- Software Engineering Evaluator jobs in Maple Valley, WA
- Software Engineering Evaluator jobs in Mercer Island, WA
- Software Engineering Evaluator jobs in Bainbridge Island, WA
- Software Engineering Evaluator jobs in Tukwila, WA
- Software Engineering Evaluator jobs in Bonney Lake, WA
- Software Engineering Evaluator jobs in Covington, WA