229 software engineering evaluator jobs at 123 companies in Benicia, CA
6d
Save
Mark Applied
Hide
Manager, Software Engineering Omni Channel Management
Santa Clara, California, United States
$167k-$291k/yr OnsiteFull Time
8+ YOE5+ MgmtRequires 8+ years related experience with a bachelor's or 6+ with a master's, 5+ years leading technical teams, and hands-on AI-native software, agentic workflows, conversational systems, evaluation, security, and production delivery.
Voice AI, Chat AI, Electronic Health Records, APIs, IVR, ESPP, ServiceNow AI
1mo
Save
Mark Applied
Hide
Software Engineering Manager - Build Agent
Santa Clara, California, United States
$167k-$291k/yr OnsiteFull Time
6+ YOE6+ years with relevant technologies, advanced coding in Java, C++, Ruby, Shell, or JavaScript, LLM evaluation experience, coding-agent architecture knowledge, cross-team leadership, and people management experience.
Java, C++, Ruby, Shell, JavaScript, ServiceNow, Build Agent, Pass@1
1d
Save
Mark Applied
Hide
JavaScript Developer
United States or Chicago or San Francisco
$200-$300/hr RemoteContract
3+ YOERequires 3+ years of software engineering experience, systems, infrastructure, or backend expertise, production software experience, and strong architecture, debugging, code review, and communication skills.
Python, C, C++, Rust, Go, Java, JavaScript, ReactJS
1mo
Save
Mark Applied
Hide
Software Engineering SMTS
San Francisco, California, United States
$179k-$246k/yr OnsiteFull Time
Strong Java fundamentals, experience with CI/CD automation, evaluating LLM/GPT integrations, agile delivery, cross-functional collaboration, and delivering scalable AI-first testing frameworks.
Java, LLM, GPT, CI/CD, AWS, Azure, GCP, Salesforce
2w
Save
Mark Applied
Hide
Staff Software Engineer, Capacity Engineering
San Francisco or United States
$177k-$365k/yr HybridFull Time
Bachelor's degree or equivalent experience; expertise in capacity, performance, Kubernetes, distributed systems, cloud environments, and software development; proficiency in Java, Python, and C++; AI evaluation and verification skills.
Kubernetes, Java, Python, C++, AWS
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Legal — CoCounsel Forward Deployed Engineering
Frisco or New York City or Toronto or Ann Arbor or Eagan or San Francisco or Los Angeles or Irvine or McLean or Washington
$95k-$176k/yr HybridFull Time
5+ YOEJD or formal legal training (or equivalent experience),5+ years software engineering,proficiency in Python,AI/LLM evaluation and prompt engineering,ability to engage legal users and mentor engineers,experience delivering production-grade SaaS solutions.
Python
2w
Save
Mark Applied
Hide
Software Engineer, Integrations
Europe or London or San Francisco or New York City or United Kingdom or Toronto or Montreal or Paris or Berlin or Seoul
$150k-$270k/yr RemoteFull Time
Production software engineering experience, external API integration experience, agentic system evaluation or familiarity with evals, prompt engineering, tool-description tuning, and end-to-end ownership.
AI, APIs
3w
Save
Mark Applied
Hide
Director of Engineering, AI Platform
San Francisco, California, United States
$306k-$360k/yr HybridFull Time
12+ YOE5+ Mgmt12+ years software engineering experience with 5+ years engineering leadership, experience managing engineering managers, expertise in AI serving, inference, retrieval, evaluation, cost optimization, and cross-functional partnership.
1w
Save
Mark Applied
Hide
Software Engineer - Applied AI
New York City or San Francisco
$170k-$225k/yr HybridFull Time
4+ YOERequires 4+ years of software engineering experience, experience shipping AI systems, prompt and context engineering, evaluation design, dependable probabilistic systems, strong communication, and willingness to learn trusts.
Go, Postgres, Temporal, GraphQL, Honeycomb, Braintrust, PostHog, Meticulous, Amp, CI
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Evaluation Flywheel — Autonomous Vehicles
Santa Clara or Washington or Georgia or North Carolina or Washington
$224k-$357k/yr RemoteFull Time
12+ YOE12+ years software engineering experience, strong Python and data engineering skills, deep experience evaluating ML/robotics systems, metric and dataset curation, and technical leadership.
Python, LLMs, VLMs
2w
Save
Mark Applied
Hide
Builder - Senior Software Engineer, AI
Santa Clara, California, United States
OnsiteFull Time
5+ YOE5+ years of software engineering experience focused on AI/ML systems, with expertise in LLMs, RAG, AI frameworks, model deployment, monitoring, prompt engineering, evaluation, vector databases, and semantic search.
RAG, large language models, AI/ML, ML operations, vector databases, embedding systems, semantic search
3mo
Save
Mark Applied
Hide
Staff Software Engineer, Agents
San Francisco, California, United States
$231k-$340k/yr HybridFull Time
8+ YOE8+ years software engineering experience, Python, LLM APIs, agent frameworks; experience shipping user-facing products; strong evaluation and iteration skills.
Python, LLM APIs, Agent Frameworks, Backend Development
2w
Save
Mark Applied
Hide
Software Engineer, Applied AI Infrastructure
Mountain View, California, United States
$194k-$352k/yr OnsiteFull Time
3+ YOE3+ years of software engineering experience, or 2+ with a Master's; strong Python, LLM research, agent systems, backend and distributed systems, ML infrastructure, evaluation, and inference experience.
Python, Go, C++, Rust, SFT, RL
1w
Save
Mark Applied
Hide
Software Engineer, AI Evaluation
San Francisco, California, United States
$148k-$232k/yr HybridFull Time
Significant production systems experience; expertise evaluating AI systems, agentic tooling, adversarial testing, statistics, experimental design, and functional UI development for non-engineers.
LangSmith, Braintrust, DeepEval, Ragas, Promptfoo
1mo
Save
Mark Applied
Hide
Principal Software Engineer
Redmond or Mountain View or New York
$143k-$275k/yr HybridFull Time
6+ YOEBachelor's in CS or related and 6+ years engineering experience (or equivalent), coding in .Net/Java/JavaScript/Rust/Python; experience with distributed systems, AI evaluation, and reliability engineering.
.Net, Java, JavaScript, Rust, Python
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Localization
Mountain View, California, United States
$180k-$230k/yr OnsiteFull Time
Expertise in state estimation, inertial navigation, sensor fusion and odometry; strong C++ and software engineering skills; experience with IMU, GNSS, camera, and lidar data; strong communication and evaluation skills.
C++, Endorsed
4w
Save
Mark Applied
Hide
Senior Software Engineer, Simulation Evaluation
Sunnyvale, California, United States
$129k-$198k/yr HybridFull Time
5+ YOE5+ years building evaluation/simulation/test frameworks, production Python proficiency, strong communication, BS/MS/PhD in CS/Engineering or equivalent experience.
Python, SQL, Looker, Streamlit
2w
Save
Mark Applied
Hide
Software Engineer II
San Francisco, California, United States
$170k-$215k/yr OnsiteFull Time
2+ YOE2–5 years of professional experience designing, building, and shipping production software end-to-end, including LLM-based products and evaluation of model output. High agency and onsite availability required.
LLMs, Claude Enterprise
3w
Save
Mark Applied
Hide
Software Engineer, Machine Learning Infrastructure - Generative AI
San Francisco or Sunnyvale or Seattle
$137k-$299k/yr OnsiteFull Time
3+ YOEBachelor's, master's, or doctoral degree in computer science or equivalent; 3+ years of software engineering experience; Python, distributed systems, production infrastructure, and LLM evaluation or observability experience.
Python, OpenTelemetry, SQL, Kubernetes, AWS, GCP, RAG, MCP, Claude Code, Codex, Cursor, Gem, Covey
3w
Save
Mark Applied
Hide
Software Engineer - Evaluation
Fremont, California, United States
$120k-$200k/yr OnsiteFull Time
Strong programming in C/C++ and Python, deep math/theoretical CS foundation, BS/MS/PhD in CS or related field, experience building large-scale systems and evaluation frameworks.
C/C++, Python