125 software engineering evaluator jobs at 85 companies in Napa, CA
1d
Save
Mark Applied
Hide
JavaScript Developer
United States or Chicago or San Francisco
$200-$300/hr RemoteContract
3+ YOERequires 3+ years of software engineering experience, systems, infrastructure, or backend expertise, production software experience, and strong architecture, debugging, code review, and communication skills.
Python, C, C++, Rust, Go, Java, JavaScript, ReactJS
1mo
Save
Mark Applied
Hide
Software Engineering SMTS
San Francisco, California, United States
$179k-$246k/yr OnsiteFull Time
Strong Java fundamentals, experience with CI/CD automation, evaluating LLM/GPT integrations, agile delivery, cross-functional collaboration, and delivering scalable AI-first testing frameworks.
Java, LLM, GPT, CI/CD, AWS, Azure, GCP, Salesforce
2w
Save
Mark Applied
Hide
Staff Software Engineer, Capacity Engineering
San Francisco or United States
$177k-$365k/yr HybridFull Time
Bachelor's degree or equivalent experience; expertise in capacity, performance, Kubernetes, distributed systems, cloud environments, and software development; proficiency in Java, Python, and C++; AI evaluation and verification skills.
Kubernetes, Java, Python, C++, AWS
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Legal — CoCounsel Forward Deployed Engineering
Frisco or New York City or Toronto or Ann Arbor or Eagan or San Francisco or Los Angeles or Irvine or McLean or Washington
$95k-$176k/yr HybridFull Time
5+ YOEJD or formal legal training (or equivalent experience),5+ years software engineering,proficiency in Python,AI/LLM evaluation and prompt engineering,ability to engage legal users and mentor engineers,experience delivering production-grade SaaS solutions.
Python
2w
Save
Mark Applied
Hide
Software Engineer, Integrations
Europe or London or San Francisco or New York City or United Kingdom or Toronto or Montreal or Paris or Berlin or Seoul
$150k-$270k/yr RemoteFull Time
Production software engineering experience, external API integration experience, agentic system evaluation or familiarity with evals, prompt engineering, tool-description tuning, and end-to-end ownership.
AI, APIs
3w
Save
Mark Applied
Hide
Director of Engineering, AI Platform
San Francisco, California, United States
$306k-$360k/yr HybridFull Time
12+ YOE5+ Mgmt12+ years software engineering experience with 5+ years engineering leadership, experience managing engineering managers, expertise in AI serving, inference, retrieval, evaluation, cost optimization, and cross-functional partnership.
1w
Save
Mark Applied
Hide
Software Engineer - Applied AI
New York City or San Francisco
$170k-$225k/yr HybridFull Time
4+ YOERequires 4+ years of software engineering experience, experience shipping AI systems, prompt and context engineering, evaluation design, dependable probabilistic systems, strong communication, and willingness to learn trusts.
Go, Postgres, Temporal, GraphQL, Honeycomb, Braintrust, PostHog, Meticulous, Amp, CI
3mo
Save
Mark Applied
Hide
Staff Software Engineer, Agents
San Francisco, California, United States
$231k-$340k/yr HybridFull Time
8+ YOE8+ years software engineering experience, Python, LLM APIs, agent frameworks; experience shipping user-facing products; strong evaluation and iteration skills.
Python, LLM APIs, Agent Frameworks, Backend Development
1w
Save
Mark Applied
Hide
Software Engineer, AI Evaluation
San Francisco, California, United States
$148k-$232k/yr HybridFull Time
Significant production systems experience; expertise evaluating AI systems, agentic tooling, adversarial testing, statistics, experimental design, and functional UI development for non-engineers.
LangSmith, Braintrust, DeepEval, Ragas, Promptfoo
2w
Save
Mark Applied
Hide
Software Engineer II
San Francisco, California, United States
$170k-$215k/yr OnsiteFull Time
2+ YOE2–5 years of professional experience designing, building, and shipping production software end-to-end, including LLM-based products and evaluation of model output. High agency and onsite availability required.
LLMs, Claude Enterprise
3w
Save
Mark Applied
Hide
Software Engineer, Machine Learning Infrastructure - Generative AI
San Francisco or Sunnyvale or Seattle
$137k-$299k/yr OnsiteFull Time
3+ YOEBachelor's, master's, or doctoral degree in computer science or equivalent; 3+ years of software engineering experience; Python, distributed systems, production infrastructure, and LLM evaluation or observability experience.
Python, OpenTelemetry, SQL, Kubernetes, AWS, GCP, RAG, MCP, Claude Code, Codex, Cursor, Gem, Covey
4w
Save
Mark Applied
Hide
Software Engineer, Enterprise Verticals
San Francisco, California, United States
$293k-$325k/yr HybridFull Time
Full‑stack product engineering across frontend, backend, APIs, data, evaluations, and enterprise reliability with strong product judgment and customer collaboration.
ChatGPT Work, plugins, connectors, APIs
3w
Save
Mark Applied
Hide
Software Engineer, Client Solutions
San Francisco or New York City
$150k-$170k/yr HybridFull Time
3+ YOE3+ years professional Python experience, experience with LLM evaluation, relational databases, APIs, ETL, strong communication and critical thinking; BS in CS/Engineering preferred.
Python, FastAPI, SQLAlchemy, Postgres, Docker, Kubernetes, AWS, GitHub Actions, React, FHIR, HL7, EDI
2mo
Save
Mark Applied
Hide
Principal Software Engineer, Crusoe Cloud
San Francisco, California, United States
$256k-$320k/yr OnsiteFull Time
Principal-level engineer to design scalable cloud platform architecture, evaluate services/tools, write technical designs, contribute code, and mentor engineers to improve customer experience.
2w
Save
Mark Applied
Hide
Software Engineer, Applied AI
San Francisco or Los Angeles or Washington or San Diego or Seattle or London
$150k-$170k/yr HybridFull Time
2+ YOEBS/MS in a technical field, 2+ years of software development, strong Python, production systems, AI/ML integration, model evaluation, and familiarity with APIs, distributed systems, containers, CI/CD, observability, and edge deployment.
Python, APIs, CI/CD, GPU
2mo
Save
Mark Applied
Hide
Staff software engineer, AI platform
San Francisco, California, United States
$202k-$255k/yr OnsiteFull Time
6+ YOE6+ years backend/platform or AI/ML engineering; experience with LLMs, embeddings, model evaluation, agent observability; full lifecycle production experience; TypeScript experience; strong communication and critical thinking.
LLMs, TypeScript
1w
Save
Mark Applied
Hide
Software Engineer- Benchmarking
San Francisco or New York City
$160k-$210k/yr HybridFull Time
4+ YOERequires 4+ years building complex systems, strong Python, dataset preparation and maintenance, Docker, reproducible environments, and collaboration with researchers; AI evaluation experience is a plus.
Python, Docker, React, Next.js, Tailwind, GitHub, Slack, Notion, Linear, PyTorch, Hugging Face, Harbor, Terminal-Bench, Inspect
1mo
Save
Mark Applied
Hide
Software Engineer - Perception
San Francisco, California, United States
OnsiteFull Time
Experience building high-throughput data platforms, distributed streaming systems, scalable data pipelines for multimodal media, and closed-loop evaluation infrastructure for perception systems.
2w
Save
Mark Applied
Hide
Head of AI Engineering at AIOS — Remote, $200-$400k/yr + equity
Austin or San Francisco or London or New York City or United States or United Kingdom
$200k-$400k/yr RemoteFull Time
8+ YOERequires 8+ years of software engineering, a technical bachelor's degree, production agent-building experience, systems expertise, evaluation design, safe consequential actions, model judgment, and small-team leadership.
AIOS Agent SDK, Macbook
1d
Save
Mark Applied
Hide
Software Engineer, Model Evaluation and Improvement
San Francisco, California, United States
$136k-$167k/yr OnsiteFull Time
2+ YOERequires 2+ years at the intersection of biology and AI, experience evaluating or improving biological models or LLMs, LLM development experience, and collaborative problem-solving skills.
LLMs
Explore Jobs
Expand Your Job Search
Top Cities Near Napa for Software Engineering Evaluator
- Software Engineering Evaluator jobs in San Francisco, CA
- Software Engineering Evaluator jobs in Sacramento, CA
- Software Engineering Evaluator jobs in Oakland, CA
- Software Engineering Evaluator jobs in Santa Rosa, CA
- Software Engineering Evaluator jobs in Hayward, CA
- Software Engineering Evaluator jobs in Concord, CA
- Software Engineering Evaluator jobs in Vallejo, CA
- Software Engineering Evaluator jobs in Berkeley, CA
- Software Engineering Evaluator jobs in Fairfield, CA
- Software Engineering Evaluator jobs in Antioch, CA
- Software Engineering Evaluator jobs in Richmond, CA
- Software Engineering Evaluator jobs in Daly City, CA
- Software Engineering Evaluator jobs in Vacaville, CA
- Software Engineering Evaluator jobs in San Leandro, CA
- Software Engineering Evaluator jobs in Pleasanton, CA
- Software Engineering Evaluator jobs in Alameda, CA
- Software Engineering Evaluator jobs in San Ramon, CA
- Software Engineering Evaluator jobs in Pittsburg, CA
- Software Engineering Evaluator jobs in Walnut Creek, CA
- Software Engineering Evaluator jobs in Davis, CA