HiringCafe
Join our community

23 model serving engineer jobs at 22 companies in Fairfield, CA

PromotedHiringCafe
ML Engineer - Inference & Model Deployment
Cupertino, CA, US
$250k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Turn powerful AI and ML models into fast, reliable production systems. Own inference latency, throughput, model-serving architecture, multi-GPU systems, and production deployment for millions of users.
Python, PyTorch, vLLM, SGLang, TensorRT, LLMs
Help us #BeatIndeed & #BeatLinkedIn
1mo
Save
Mark Applied
Hide
Software Engineer, ML Serving
San Francisco, California, United States
HybridFull Time
Rime Labs
Rime Labs: Developing enterprise-grade, real-time voice AI models.
Hands-on experience with real-time multinode ML serving, distributed model serving, Linux internals, networking, containerization (Docker, Kubernetes), IaC (Terraform, Packer), and on-call/production reliability responsibilities.
NVIDIA Dynamo, Triton, vLLM, SGLang, DDP, FSDP, Linux, Docker, Kubernetes, Terraform, Packer, gRPC, WebRTC, WebSockets, Ansible, Chef, Puppet, AWS, GCP, OCI, Hopper, Blackwell
Job PostingView all
2mo
Save
Mark Applied
Hide
AI Engineer - Model Performance
San Francisco, California, United States
HybridFull Time
Fathom
Fathom: AI assistant for recording, transcribing, and summarizing virtual meetings.
Deep experience with LLM serving frameworks, quantization, and production fine-tuning; strong Python and GPU performance analysis.
Python, PyTorch, vLLM, SGLang, TensorRT-LLM, LoRA, QLoRA, torchtune, Axolotl
Job PostingView all
1d
Save
Mark Applied
Hide
Staff Software Engineer, Foundation Model API
San Francisco or Mountain View
$190k-$265k/yr OnsiteFull Time
Databricks
Databricks: A unified platform for data analytics and artificial intelligence.
8+ YOE8+ years backend/infrastructure experience, distributed systems, scalable APIs, cloud-native infra, real-time serving/ML infra/GPU orchestration, strong Scala/Go/Python skills, product ownership and customer engagement.
OpenAI, Anthropic, Gemini, Qwen, GPT-OSS, Llama, SageMaker, Vertex AI, Azure ML, FMAPI, Apache Spark™, Delta Lake, MLflow, Scala, Go, Python
Job PostingView all
3mo
Save
Mark Applied
Hide
Software Engineer, Model Routing & Inference
New York or San Francisco
OnsiteFull Time
Cursor
Cursor: AI-powered code editor for professional software developers.
Experience building high-throughput, low-latency distributed systems; inference serving; traffic routing; production software delivery; cost-performance tradeoffs.
Job PostingView all
1w
Save
Mark Applied
Hide
Staff, MLOps Engineer
New York City or San Francisco or United States
$220k-$280k/yr RemoteFull Time
Sequen AI: AI-native ranking engine for enterprise search and recommendations.
4+ YOEMinimum 4+ years MLOps or ML/platform engineering; expertise with low-latency model serving, Python and PyTorch; cloud (AWS/GCP/Azure), Docker, Kubernetes, MLflow; strong distributed systems and pipeline experience.
Python, PyTorch, AWS, GCP, Azure, Docker, Kubernetes, MLflow, Rust, vLLM, Triton
Job PostingView all
2mo
Save
Mark Applied
Hide
Machine Learning Engineer, Inference & Serving (Speech LLM) - San Francisco
San Francisco, California, United States
$180k-$270k/yr HybridFull Time
Plaud
Plaud: Develops AI-powered voice recorders and automated transcription software.
Experience building and deploying high-throughput, ultra-low-latency inference for LLMs or speech models; optimize latency/throughput; manage KV cache; understand GPU memory hierarchies; collaborate across ML and backend teams.
vLLM, TensorRT-LLM, SGLang, NVIDIA Triton Inference Server, WebSockets, WebRTC, CUDA, PTQ, FP8, INT8, AWQ, GPTQ, Tensor Parallelism, Kubernetes
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Machine Learning Engineer
San Francisco or Minneapolis
HybridFull Time
Shipt
Shipt: Provides same-day delivery services from local retailers via app.
5+ YOE5+ years of machine learning and backend software engineering; backend in Go/Java and Python; embeddings, similarity search, ranking models; ML pipelines; distributed systems; SQL/NoSQL; API serving; A/B testing.
Go, Java, Python, MLflow, Kubeflow, Airflow, REST, gRPC, Model servers, SQL, NoSQL
Job PostingView all
1mo
Save
Mark Applied
Hide
AI Field Engineer - AI Natives
New York or San Mateo or United States
$200k-$260k/yr OnsiteFull Time
Fireworks AI
Fireworks AI: Provide high-speed inference and infrastructure for generative AI models.
5+ YOE5+ years in customer-facing technical roles building production software; strong Python and Kubernetes skills; experience with LLM inference, model serving, fine-tuning workflows, GPU/cloud deployments, and excellent communication.
Python, Kubernetes, vLLM, SGLang, TensorRT-LLM, AWS, Azure, GCP, Azure AI Foundry, AWS Bedrock, SageMaker, GCP Vertex
Job PostingView all
1w
Save
Mark Applied
Hide
Analytics Engineer, Revenue
San Mateo or Provo or United States
$181k-$245k/yr RemoteFull Time
GC AI
GC AI: AI-powered legal platform for in-house legal teams.
5+ YOE5+ years in data engineering/analytics with strong SQL, data modeling, dbt and BI experience; builds dimensional models, KPIs, and self-serve analytics; cross-functional collaboration with Revenue and Finance.
SQL, dbt, Looker, Tableau, Sigma, BigQuery, Snowflake, Python, CRM, Monte Carlo, Great Expectations
Job PostingView all
2mo
Save
Mark Applied
Hide
ML Infrastructure Engineer
San Francisco, California, United States
$160k-$200k/yr OnsiteFull Time
Mach9
Mach9: AI-powered software that automates feature extraction from geospatial data.
3+ YOE3+ years in ML infrastructure; BS/MS in CS/Engineering; strong Python and PyTorch; data versioning, pipelines, and model serving experience; good communication.
Python, PyTorch, Airflow, Prefect, Metaflow, DVC, Weights & Biases, TensorRT, ONNX Runtime, Terraform, AWS
Job PostingView all
2w
Save
Mark Applied
Hide
Sr. ML Engineer – ML & Applied AI
San Francisco, California, United States
$181k-$236k/yr OnsiteFull Time
Gap Inc.
Gap Inc.NYSE: GAP: Global specialty retailer of apparel and accessories.
10+ YOE10+ years building production ML systems; strong Python and software engineering; experience with ML frameworks, model serving, MLOps, cloud platforms, and distributed data processing.
Python, scikit-learn, XGBoost, PyTorch, TensorFlow, FastAPI, Flask, Docker, Kubernetes, GCP, AWS, Azure, Git, Spark, PySpark, Databricks
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Machine Learning Engineer (Pricing)
San Francisco, California, United States
HybridFull Time
GoFundMe
GoFundMe: Provides an online platform for personal and nonprofit fundraising.
7+ YOE7+ years building production ML systems; Python and ML libraries; pricing/monetization or growth optimization; real-time model serving; data engineering; ML monitoring; leadership.
Python, PyTorch, TensorFlow, Scikit-learn, AWS, Databricks, Docker, Kubernetes, FastAPI, Terraform, Snowflake, GitHub
Job PostingView all
3w
Save
Mark Applied
Hide
Head of Developer Relations
San Mateo, California, United States
$160k-$240k/yr HybridFull Time
Parasail
Parasail: Provides scalable cloud infrastructure for AI model inference.
6+ YOE6+ years combined software engineering, DevRel, and technical content experience; strong technical fluency in inference/model serving; prior experience growing developer communities and producing technical content and benchmarks.
Discord, Hacker News
Job PostingView all
1mo
Save
Mark Applied
Hide
Member of Technical Staff, Developer Relations
San Francisco, California, United States
$200k-$400k/yr OnsiteFull Time
Inferact
Inferact: An AI infrastructure building vLLM to accelerate and scale model inference.
Bachelor's or equivalent experience in CS/engineering/ML, deep knowledge of LLM inference and model serving, experience with vLLM or adjacent systems, strong technical writing/teaching portfolio, and ability to build demos and tutorials.
vLLM, SGLang, TensorRT-LLM, TGI, LoRAX, Ray Serve, FlashInfer, BentoML, Baseten, CUDA, PyTorch, Modal, Predibase, Together AI, Anyscale, LMSYS
Job PostingView all
2w
Save
Mark Applied
Hide
Sr. Machine Learning Engineer, Infrastructure
Mountain View or Bellevue or San Francisco
$210k-$316k/yr OnsiteFull Time
Unity
UnityNYSE: U: Provides software for creating real-time 3D interactive content.
Experience building and operating ML infrastructure and model serving systems; proficiency in Golang or Python; Kubernetes experience; familiarity with ML serving frameworks and distributed systems; strong collaboration and communication.
Golang, Python, Kubernetes, Ray Serve, Triton, TorchServe, Terraform, Prometheus, Grafana, OpenTelemetry
Job PostingView all
3w
Save
Mark Applied
Hide
AI Engineer I
South San Francisco, California, United States
$100k-$159k/yr OnsiteFull Time
Frontier Medicines
Frontier Medicines: Developing precision medicines for traditionally undruggable disease-causing proteins.
1+ YOEBSc (2–3 yrs) or PhD (1+ yr) in a quantitative field, strong Python programming, experience designing/training multimodal and generative ML models (self-supervised, MoE, DeepSpeed/FSDP), and ability to deploy/serve models for drug discovery; legal US work authorization required.
Python, DeepSpeed, FSDP, Mixture of experts (MoE), RAG, GNNs, VAEs
Job PostingView all
4w
Save
Mark Applied
Hide
Senior Research Engineer
San Francisco, California, United States
$175k-$250k/yr OnsiteFull Time
Mem0
Mem0: Provides persistent memory layers for artificial intelligence applications.
Experience with RAG/IR, model training and fine-tuning (LLMs/encoders), strong Python and PyTorch skills, familiarity with vLLM and serving frameworks, evaluation at scale, orchestration of low-latency data pipelines, and clear stakeholder communication.
Python, PyTorch, vLLM
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior / Staff Machine Learning Research Engineer
South San Francisco, California, United States
$209k-$233k/yr HybridFull Time
Calico
Calico: Researching aging biology to develop longevity-improving therapies.
5+ YOE5+ years ML software engineering experience; strong Python and JAX or PyTorch skills; experience building model training/serving/eval platforms; willing to work onsite at least four days/week.
Python, JAX, PyTorch, Ray, Spark, BigQuery, AlphaFold
Job PostingView all
2d
Save
Mark Applied
Hide
Senior Software Engineer: Assistant
San Mateo, California, United States
$197k-$243k/yr HybridFull Time
Roblox
RobloxNYSE: RBLX: Platform for creating and playing user-generated 3D digital experiences.
5+ YOE5+ years building large-scale software; experience with AI infrastructure, model serving, orchestration, agentic systems; proficiency in C++, C#, Java, SQL/NoSQL; strong system design and leadership skills.
C++, C#, Java, SQL, NoSQL, LLM
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Machine Learning Engineer, Voice AI
San Francisco, California, United States
$220k-$280k/yr OnsiteFull Time
Together AI
Together AI: Cloud platform for training and deploying artificial intelligence models.
8+ YOE8+ years ML engineering experience focused on model serving, inference optimization, and ML infrastructure at production scale; strong Python/PyTorch, GPU optimization, and system design skills; leadership and developer tooling experience; domain knowledge in speech/audio AI preferred.
Python, PyTorch, CUDA, TensorRT-LLM, vLLM, SGLang
Job PostingView all

Explore Jobs

Expand Your Job Search