192 software engineering evaluator jobs at 118 companies in San Rafael, CA

19h
Save
Mark Applied
Hide
JavaScript Developer
United States or Chicago or San Francisco
$200-$300/hr RemoteContract
Turing
Turing: AI-powered platform connecting companies with global remote software developers.
3+ YOERequires 3+ years of software engineering experience, systems, infrastructure, or backend expertise, production software experience, and strong architecture, debugging, code review, and communication skills.
Python, C, C++, Rust, Go, Java, JavaScript, ReactJS
1mo
Save
Mark Applied
Hide
Software Engineering SMTS
San Francisco, California, United States
$179k-$246k/yr OnsiteFull Time
Salesforce
SalesforceNYSE: CRM: Sells cloud-based customer relationship management and business software solutions.
Strong Java fundamentals, experience with CI/CD automation, evaluating LLM/GPT integrations, agile delivery, cross-functional collaboration, and delivering scalable AI-first testing frameworks.
Java, LLM, GPT, CI/CD, AWS, Azure, GCP, Salesforce
2w
Save
Mark Applied
Hide
Staff Software Engineer, Capacity Engineering
San Francisco or United States
$177k-$365k/yr HybridFull Time
Pinterest
PinterestNYSE: PINS: Visual discovery engine for finding and saving ideas.
Bachelor's degree or equivalent experience; expertise in capacity, performance, Kubernetes, distributed systems, cloud environments, and software development; proficiency in Java, Python, and C++; AI evaluation and verification skills.
Kubernetes, Java, Python, C++, AWS
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Legal — CoCounsel Forward Deployed Engineering 
Frisco or New York City or Toronto or Ann Arbor or Eagan or San Francisco or Los Angeles or Irvine or McLean or Washington
$95k-$176k/yr HybridFull Time
Thomson Reuters
Thomson ReutersNASDAQ: TRI: Provides professional software, data, and news services globally.
5+ YOEJD or formal legal training (or equivalent experience),5+ years software engineering,proficiency in Python,AI/LLM evaluation and prompt engineering,ability to engage legal users and mentor engineers,experience delivering production-grade SaaS solutions.
Python
2w
Save
Mark Applied
Hide
Software Engineer, Integrations
Europe or London or San Francisco or New York City or United Kingdom or Toronto or Montreal or Paris or Berlin or Seoul
$150k-$270k/yr RemoteFull Time
Cohere
Cohere: Provides enterprise-grade large language models and AI software platforms.
Production software engineering experience, external API integration experience, agentic system evaluation or familiarity with evals, prompt engineering, tool-description tuning, and end-to-end ownership.
AI, APIs
3w
Save
Mark Applied
Hide
Director of Engineering, AI Platform
San Francisco, California, United States
$306k-$360k/yr HybridFull Time
Asana
AsanaNYSE: ASAN: Software platform for team project management and workflow automation.
12+ YOE5+ Mgmt12+ years software engineering experience with 5+ years engineering leadership, experience managing engineering managers, expertise in AI serving, inference, retrieval, evaluation, cost optimization, and cross-functional partnership.
1w
Save
Mark Applied
Hide
Software Engineer - Applied AI
New York City or San Francisco
$170k-$225k/yr HybridFull Time
Luminary
Luminary: AI-powered estate planning software for wealth management advisors.
4+ YOERequires 4+ years of software engineering experience, experience shipping AI systems, prompt and context engineering, evaluation design, dependable probabilistic systems, strong communication, and willingness to learn trusts.
Go, Postgres, Temporal, GraphQL, Honeycomb, Braintrust, PostHog, Meticulous, Amp, CI
3mo
Save
Mark Applied
Hide
Staff Software Engineer, Agents
San Francisco, California, United States
$231k-$340k/yr HybridFull Time
Harvey
Harvey: AI platform for legal research and document analysis.
8+ YOE8+ years software engineering experience, Python, LLM APIs, agent frameworks; experience shipping user-facing products; strong evaluation and iteration skills.
Python, LLM APIs, Agent Frameworks, Backend Development
2w
Save
Mark Applied
Hide
Software Engineer, Applied AI Infrastructure
Mountain View, California, United States
$194k-$352k/yr OnsiteFull Time
Nuro
Nuro: Builds autonomous driving software and electric delivery robots.
3+ YOE3+ years of software engineering experience, or 2+ with a Master's; strong Python, LLM research, agent systems, backend and distributed systems, ML infrastructure, evaluation, and inference experience.
Python, Go, C++, Rust, SFT, RL
1w
Save
Mark Applied
Hide
Software Engineer, AI Evaluation
San Francisco, California, United States
$148k-$232k/yr HybridFull Time
Nuna
Nuna: Provides data analytics and software for value-based healthcare solutions.
Significant production systems experience; expertise evaluating AI systems, agentic tooling, adversarial testing, statistics, experimental design, and functional UI development for non-engineers.
LangSmith, Braintrust, DeepEval, Ragas, Promptfoo
1mo
Save
Mark Applied
Hide
Principal Software Engineer
Redmond or Mountain View or New York
$143k-$275k/yr HybridFull Time
Microsoft
MicrosoftNASDAQ: MSFT: Develops software, services, devices, and cloud computing solutions.
6+ YOEBachelor's in CS or related and 6+ years engineering experience (or equivalent), coding in .Net/Java/JavaScript/Rust/Python; experience with distributed systems, AI evaluation, and reliability engineering.
.Net, Java, JavaScript, Rust, Python
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Localization
Mountain View, California, United States
$180k-$230k/yr OnsiteFull Time
Kodiak Robotics
Kodiak RoboticsNASDAQ: KDK: Develops autonomous driving technology for commercial trucking and defense.
Expertise in state estimation, inertial navigation, sensor fusion and odometry; strong C++ and software engineering skills; experience with IMU, GNSS, camera, and lidar data; strong communication and evaluation skills.
C++, Endorsed
4w
Save
Mark Applied
Hide
Senior Software Engineer, Simulation Evaluation
Sunnyvale, California, United States
$129k-$198k/yr HybridFull Time
General Motors
General MotorsNYSE: GM: Manufactures and sells automobiles and automotive parts globally.
5+ YOE5+ years building evaluation/simulation/test frameworks, production Python proficiency, strong communication, BS/MS/PhD in CS/Engineering or equivalent experience.
Python, SQL, Looker, Streamlit
2w
Save
Mark Applied
Hide
Software Engineer II
San Francisco, California, United States
$170k-$215k/yr OnsiteFull Time
interface.ai
interface.ai: AI-powered automation platform for banks and credit unions.
2+ YOE2–5 years of professional experience designing, building, and shipping production software end-to-end, including LLM-based products and evaluation of model output. High agency and onsite availability required.
LLMs, Claude Enterprise
3w
Save
Mark Applied
Hide
Software Engineer, Machine Learning Infrastructure - Generative AI
San Francisco or Sunnyvale or Seattle
$137k-$299k/yr OnsiteFull Time
DoorDash
DoorDashNYSE: DASH: Local food delivery and on-demand logistics platform.
3+ YOEBachelor's, master's, or doctoral degree in computer science or equivalent; 3+ years of software engineering experience; Python, distributed systems, production infrastructure, and LLM evaluation or observability experience.
Python, OpenTelemetry, SQL, Kubernetes, AWS, GCP, RAG, MCP, Claude Code, Codex, Cursor, Gem, Covey
3w
Save
Mark Applied
Hide
Software Engineer - Evaluation
Fremont, California, United States
$120k-$200k/yr OnsiteFull Time
Pony.ai
Pony.aiNASDAQ: PONY: Develops autonomous driving technology for passenger and freight transportation.
Strong programming in C/C++ and Python, deep math/theoretical CS foundation, BS/MS/PhD in CS or related field, experience building large-scale systems and evaluation frameworks.
C/C++, Python
4w
Save
Mark Applied
Hide
Software Engineer, Enterprise Verticals
San Francisco, California, United States
$293k-$325k/yr HybridFull Time
OpenAI
OpenAI: Develops artificial intelligence models and generative AI software services.
Full‑stack product engineering across frontend, backend, APIs, data, evaluations, and enterprise reliability with strong product judgment and customer collaboration.
ChatGPT Work, plugins, connectors, APIs
1mo
Save
Mark Applied
Hide
Staff Software Engineer, Vertex GenAI Evaluation Service
Sunnyvale, California, United States
$207k-$301k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
8+ YOE8+ years software development experience, 5+ years testing and product launches, ML and GenAI experience, design and architecture experience, EM/LLM evaluation expertise preferred.
3w
Save
Mark Applied
Hide
Software Engineer, Client Solutions
San Francisco or New York City
$150k-$170k/yr HybridFull Time
AKASA
AKASA: Develops AI-powered automation software for healthcare revenue cycle management.
3+ YOE3+ years professional Python experience, experience with LLM evaluation, relational databases, APIs, ETL, strong communication and critical thinking; BS in CS/Engineering preferred.
Python, FastAPI, SQLAlchemy, Postgres, Docker, Kubernetes, AWS, GitHub Actions, React, FHIR, HL7, EDI
2mo
Save
Mark Applied
Hide
Principal Software Engineer, Crusoe Cloud
San Francisco, California, United States
$256k-$320k/yr OnsiteFull Time
Crusoe
Crusoe: Provides energy-efficient cloud infrastructure powered by stranded and renewable energy.
Principal-level engineer to design scalable cloud platform architecture, evaluate services/tools, write technical designs, contribute code, and mentor engineers to improve customer experience.