965 llm engineer jobs at 468 companies in American Canyon, CA
3mo
Save
Mark Applied
Hide
3mo
Distributed LLM Inference Engineer
San Francisco or Palo Alto
$170k-$247k/yrHybridFull Time
Anyscale: Cloud platform for scaling distributed machine learning applications.
Familiarity with running ML inference at large scale with high throughput and low latency; experience with PyTorch; solid understanding of distributed systems.
Senior Research Engineer, LLM Training & Post-Training
New York City or San Francisco or Seattle or London
$165k-$310k/yrHybridFull Time
Lightning AI: Unified platform to build, train, and deploy AI models.
Requires significant PyTorch LLM training experience, distributed multi-GPU systems expertise, Python software engineering, experiment design, and a master's degree, PhD, or equivalent experience in a related field.
Clera: AI talent agent matching professionals with high-growth startup roles
8+ YOE8+ years engineering experience with production LLM systems, building evals and observability, experience with LLM agents and data-residency/SOC2/GDPR constraints, strong communication and product-engineer instincts.
Machine Learning Engineer, Model Evaluations (Speech LLM) - San Francisco
San Francisco, California, United States
$180k-$270k/yrHybridFull Time
Plaud: Develops AI-powered voice recorders and automated transcription software.
Python software engineering; building distributed systems, data pipelines, and evaluation harnesses at scale; partner with ML researchers to define benchmarks; build dashboards and monitor model health; debug mid-training anomalies; communicate results clearly.
Mira Mace: AI-powered healthcare advocacy and navigation for Medicare beneficiaries.
Staff-level backend/full-stack or ML engineering experience, production LLM/ML systems experience, architecture and build-vs-buy judgment, hands-on coding and code review, mentoring and technical leadership.
Baseten: Scalable infrastructure platform for deploying and serving AI models.
4+ YOE1+ MgmtLead a team of Forward Deployed Engineers; strong Python, ML inference, LLM experience; 4+ years software engineering; leadership experience; excellent communication.
Python, vLLM, TensorRT, Triton, Hugging Face, Ray Serve
McLean or Richmond or New York City or San Jose or Cambridge or Plano or San Francisco
$245k-$335k/yrOnsiteFull Time
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
7+ YOEBachelor's degree; 7+ years in software engineering and solution architecture; 5+ years shipping cloud platforms; 3+ years with LLM systems, RAG, embeddings, prompt tooling, and model governance.
McLean or Richmond or New York City or San Jose or Cambridge or Plano or San Francisco
$245k-$335k/yrOnsiteFull Time
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
7+ YOEBachelor's degree, 7+ years in software engineering and solution architecture, 5+ years shipping large-scale cloud platforms, and 3+ years with LLM systems including RAG, embeddings, prompt tooling, and model governance.
Beacon AI: Developing an AI-powered-pilot for safer flight operations.
Experience building LLM-powered features, RAG and tool-calling, production services in Python or TypeScript, vector search and embeddings, evals/metrics, and safety/compliance for a regulated domain.
San Francisco or New York City or Vancouver or Amsterdam or London or Paris or Singapore or Tokyo
$190k-$316k/yrHybridFull Time
AmplitudeNASDAQ: AMPL: Digital analytics platform for understanding and optimizing customer behavior.
3+ YOE3+ years software engineering experience with 2+ years building production LLM or applied AI systems; experience designing and scaling AI products, strong product sense, and collaboration skills.
Austin or Chicago or New York City or Salt Lake City or San Francisco or United States
$115k-$175k/yrRemoteFull Time
Gong: AI platform analyzing customer interactions to improve sales performance.
Background in software/data engineering or applied AI, experience shipping AI/LLM tools to production, systems thinking, API and workflow integration experience, strong independent delivery and stakeholder partnership skills.
Mondrio: AI-native platform for agentic pricing and revenue management.
8+ YOE8+ years engineering experience with production LLMs, built evals/observability, shipped LLM features, strong communication, product-engineer instincts, US work authorization required.
San Francisco or Toronto or United States or Canada
$190k-$249k/yrRemoteFull Time
EvenUp: AI-powered document generation and analysis for personal injury law.
5+ YOE5+ years engineering experience, building production-quality software; ownership of projects end-to-end; experience with frontend systems for deploying LLM-based algorithms; strong communication, mentoring, and cross-team collaboration skills.
San Francisco or Seattle or Los Angeles or New York City or United Kingdom or Ireland or Poland or Germany or Australia or North America or Europe
$200k-$260k/yrRemoteFull Time
Whatnot: Social marketplace for buying and selling via live streams
4+ YOE4+ years industry experience, 1+ years applied AI/LLM product experience; strong fluency with prompt engineering, RAG, MCP, agents, evals; systems-integration experience with APIs/webhooks; strong communication and mentorship skills.
Vantaca: AI software for community association and HOA management.
8+ YOE8+ years in infrastructure/DevOps/SRE; strong cloud expertise; experience with CI/CD, PostgreSQL, Redis, APM, model serving, vector databases, GPU optimization, and LLM deployment.
PostgreSQL, Redis, APM, CI/CD, vector databases, model serving frameworks, LLM
Chan Zuckerberg Initiative: Funds and builds technology to solve major societal challenges.
12+ YOE12+ years building production software, tech-leading small teams, full-stack engineering, cloud infrastructure/IaC, API integrations, LLMs/agents and retrieval/knowledge systems.
Variance: Autonomous AI platform for managing digital fraud and adversarial risk.
Experience shipping production systems, hands‑on LLM work (prompting, RAG, evals), strong software engineering, customer communication, and CS degree or equivalent.
Parspec: AI platform for construction product selection and procurement.
5+ YOE5+ years in forward-deployed/integration implementation engineering for B2B SaaS; degree in CS/engineering or equivalent; hands-on API/REST/JSON experience; Workato/iPaaS and ERP/CRM integrations (Eclipse, SAP, Salesforce); AI/LLM tooling; strong customer-facing and project management skills.
Harper: AI-native brokerage providing commercial insurance to businesses
Full-stack engineer with applied-AI fluency; experience shipping production systems, proficiency in Python or TypeScript, experience with LLM/agent features and frontend/backend work.