1,214 llm engineer jobs at 554 companies in Ross, CA
1mo
Save
Mark Applied
Hide
LLM Inference Engineer
Los Altos, California, United States
OnsiteFull Time
3+ YOE3+ years building or operating production LLM inference systems; strong Python and C++; experience with vLLM/SGLang/TensorRT-LLM/Fireworks; distributed inference and performance profiling skills.
vLLM, SGLang, TensorRT-LLM, Fireworks, Python, C++, collective communication library (CCL)
3mo
Save
Mark Applied
Hide
Distributed LLM Inference Engineer
San Francisco or Palo Alto
$170k-$247k/yr HybridFull Time
Familiarity with running ML inference at large scale with high throughput and low latency; experience with PyTorch; solid understanding of distributed systems.
PyTorch, Ray, vLLM, TensorRT-LLM
2w
Save
Mark Applied
Hide
Software Engineer, AI Agent & LLM
Mountain View, California, United States
$155k-$185k/yr HybridFull Time
3+ YOE3+ years building AI-agent or ML systems, strong backend/distributed-systems engineering, experience shipping LLM-powered products, evaluation of nondeterministic systems, and ability to diagnose model and system failures.
2mo
Save
Mark Applied
Hide
Machine Learning Engineer, LLM Post-Training
Mountain View, California, United States
$150k-$230k/yr OnsiteFull Time
Hands-on LLM post-training (CPT, SFT, RL) with demonstrated RL experience; strong ML data engineering; experience training LLMs on mid-to-large GPU clusters; PyTorch and related frameworks familiarity; strong communication.
PyTorch, Hugging Face TRL, Hugging Face Accelerate, DeepSpeed, FSDP, vLLM
2w
Save
Mark Applied
Hide
Senior Machine Learning Engineer, LLM Inference Optimization
Palo Alto or California
$195k-$262k/yr OnsiteFull Time
Expert Python and PyTorch skills, hands-on LLM/VLM inference deployment and optimization, knowledge of modern inference stacks, quantitative reasoning about latency/throughput/cost, and strong communication.
Python, PyTorch, vLLM, SGLang, TensorRT-LLM, Triton Inference Server, NVIDIA Dynamo, Ray Serve, KServe, CUDA, FlashInfer, LMCache, Ray
1w
Save
Mark Applied
Hide
Senior Performance Co-Design Engineer, LLM Serving
Sunnyvale, California, United States
$174k-$252k/yr OnsiteFull Time
5+ YOEBachelor's in CS/EE/CE or equivalent,5+ years in performance modeling/engineering or architecture,proficiency with C++ or Python,experience with ML serving and hardware/software co-design preferred.
C++, Python, TPU, Vertex AI
1w
Save
Mark Applied
Hide
Founding AI Engineer
San Francisco, California, United States
$225k-$255k/yr OnsiteFull Time
8+ YOE8+ years engineering experience with production LLM systems, building evals and observability, experience with LLM agents and data-residency/SOC2/GDPR constraints, strong communication and product-engineer instincts.
LLM, MCP, Anthropic, Google, LangChain, LlamaIndex, Braintrust, OpenRouter
3mo
Save
Mark Applied
Hide
Machine Learning Engineer, Model Evaluations (Speech LLM) - San Francisco
San Francisco, California, United States
$180k-$270k/yr HybridFull Time
Python software engineering; building distributed systems, data pipelines, and evaluation harnesses at scale; partner with ML researchers to define benchmarks; build dashboards and monitor model health; debug mid-training anomalies; communicate results clearly.
Python, Distributed systems, Data pipelines, Evaluation harnesses, Dashboards, Weighs & Biases, MLflow
2w
Save
Mark Applied
Hide
Staff Engineer
San Francisco, California, United States
HybridFull Time
Staff-level backend/full-stack or ML engineering experience, production LLM/ML systems experience, architecture and build-vs-buy judgment, hands-on coding and code review, mentoring and technical leadership.
Python, TypeScript, FastAPI, Next.js, Postgres, LLM
3mo
Save
Mark Applied
Hide
Engineering Manager - Forward Deployed Engineering (LLM)
San Francisco or New York
$260k-$380k/yr HybridFull Time
4+ YOE1+ MgmtLead a team of Forward Deployed Engineers; strong Python, ML inference, LLM experience; 4+ years software engineering; leadership experience; excellent communication.
Python, vLLM, TensorRT, Triton, Hugging Face, Ray Serve
1mo
Save
Mark Applied
Hide
Infrastructure Engineer
Menlo Park, California, United States
OnsiteFull Time
8+ YOE8+ years engineering experience, 5+ years Kubernetes operation, proficiency in Rust, experience with production infrastructure (physical servers, GPU/DGX clusters), CI/CD, security hardening, observability, and LLM/AI infrastructure.
Kubernetes, Rust, CI/CD, DGX, GPU, LLM, ETL
1w
Save
Mark Applied
Hide
Software Engineer, Artificial Intelligence/LLM (Multiple Seniority Levels)
San Carlos, California, United States
$135k-$260k/yr HybridFull Time
Experience building LLM-powered features, RAG and tool-calling, production services in Python or TypeScript, vector search and embeddings, evals/metrics, and safety/compliance for a regulated domain.
LangChain, Python, TypeScript, AWS Bedrock, OpenAI, Anthropic, OpenSearch, pgvector, Pinecone, Weaviate, S3, Aurora, DynamoDB, Triton, TensorRT-LLM
1mo
Save
Mark Applied
Hide
Senior AI Engineer
San Francisco or New York City or Vancouver or Amsterdam or London or Paris or Singapore or Tokyo
$190k-$316k/yr HybridFull Time
3+ YOE3+ years software engineering experience with 2+ years building production LLM or applied AI systems; experience designing and scaling AI products, strong product sense, and collaboration skills.
LLM, agent frameworks, evals
1w
Save
Mark Applied
Hide
GTM AI Engineer
Austin or Chicago or New York City or Salt Lake City or San Francisco or United States
$115k-$175k/yr RemoteFull Time
Background in software/data engineering or applied AI, experience shipping AI/LLM tools to production, systems thinking, API and workflow integration experience, strong independent delivery and stakeholder partnership skills.
Gong, Salesforce, APIs, agent frameworks, workflow orchestration, LLM
1mo
Save
Mark Applied
Hide
Staff Design Engineer, Insights
Minnesota or San Francisco or San Jose
$159k-$302k/yr RemoteFull Time
10+ YOE10+ years at the intersection of design and engineering; hands-on experience building and shipping LLM-powered apps, internal tools, and high-fidelity prototypes; strong craft, collaboration, and product judgment.
LLM, Vega, D3, Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud, Adobe Experience Platform, Adobe Experience Manager, GenStudio
2w
Save
Mark Applied
Hide
Founding AI Engineer
San Francisco, California, United States
$225k-$255k/yr OnsiteFull Time
8+ YOE8+ years engineering experience with production LLMs, built evals/observability, shipped LLM features, strong communication, product-engineer instincts, US work authorization required.
TypeScript, React, Vercel Chat SDK, Python, FastAPI, Mongo, Atlas, GCP, Pulumi, Cloudflare Pages, FastMCP, Langfuse, Claude Code, Cursor, Vercel Eve, LangChain, LlamaIndex, Braintrust, OpenRouter
3w
Save
Mark Applied
Hide
Staff Software Engineer, Agentic Applications
Mountain View, California, United States
$198k-$273k/yr OnsiteFull Time
12+ YOE12+ years software engineering experience, production LLM systems experience, human-in-the-loop design, CMS and web publishing pipeline knowledge, stakeholder collaboration, and mentoring experience.
Apache Spark, Delta Lake, MLflow, CMS, LLM
1mo
Save
Mark Applied
Hide
Senior Frontend Engineer, Platform
San Francisco or Toronto or United States or Canada
$190k-$249k/yr RemoteFull Time
5+ YOE5+ years engineering experience, building production-quality software; ownership of projects end-to-end; experience with frontend systems for deploying LLM-based algorithms; strong communication, mentoring, and cross-team collaboration skills.
LLM, Kubernetes
1w
Save
Mark Applied
Hide
Senior Forward Deployed Engineer
San Francisco, California, United States
OnsiteFull Time
5+ YOE5+ years production software engineering; expertise in Python, APIs, CI/CD, cloud integrations, LLM agent systems; strong debugging, customer-facing communication, and mentoring skills.
Python, APIs, CI/CD, LLM
1mo
Save
Mark Applied
Hide
Founding Agent Harness Engineer
Palo Alto, California, United States
OnsiteFull Time
Strong Python and systems engineering skills, experience building LLM agents, evaluation harnesses, CI/CD and developer tooling, testing and benchmarking, and ability to turn research into production systems.
Python, LLM, Agent Cloud, CI/CD, SWE-bench, RL
Explore Jobs