PromotedHiringCafe
ML Engineer - Inference & Model Deployment
Cupertino, CA, US
$250k-$310k/yr On-SiteFull Time
Turn powerful AI and ML models into fast, reliable production systems. Own inference latency, throughput, model-serving architecture, multi-GPU systems, and production deployment for millions of users.
Python, PyTorch, vLLM, SGLang, TensorRT, LLMs
3mo
Save
Mark Applied
Hide
Staff / Principal Machine Learning Engineer, Serving - USA
Mountain View, California, United States
$270k-$500k/yr HybridFull Time
Inference optimization, model acceleration, high-performance systems, distributed systems, and production ML serving. PhD or equivalent experience.
C++, CUDA, Rust, Python, Kubernetes, Ray
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer, Ad Serving
New York or San Jose
$195k-$408k/yr HybridFull Time
10+ YOE10+ years applying machine learning and optimization to production systems; deep statistics/ML expertise; production ML lifecycle experience (feature engineering, model serving, monitoring); strong software skills in Python, SQL, Java/Scala; excellent communication.
Python, SQL, Java/Scala
6d
Save
Mark Applied
Hide
Senior Machine Learning Engineer, Model Serving Infrastructure (Multiple Positions)
San Jose, California, United States
$265k-$388k/yr OnsiteFull Time
2+ YOEMaster's (plus 2 years) or Bachelor's (plus 5 years) in a quantitative field; 2+ years coding in Python or C++; Linux development experience; ML, system design, and production deployment experience.
Python, C++, Linux
9h
Save
Mark Applied
Hide
Staff Software Engineer, Foundation Model API
San Francisco or Mountain View
$190k-$265k/yr OnsiteFull Time
8+ YOE8+ years backend/infrastructure experience, distributed systems, scalable APIs, cloud-native infra, real-time serving/ML infra/GPU orchestration, strong Scala/Go/Python skills, product ownership and customer engagement.
OpenAI, Anthropic, Gemini, Qwen, GPT-OSS, Llama, SageMaker, Vertex AI, Azure ML, FMAPI, Apache Spark™, Delta Lake, MLflow, Scala, Go, Python
1mo
Save
Mark Applied
Hide
Infrastructure Engineer
Redwood City, California, United States
HybridFull Time
8+ YOE8+ years in infrastructure/DevOps/SRE; strong cloud expertise; experience with CI/CD, PostgreSQL, Redis, APM, model serving, vector databases, GPU optimization, and LLM deployment.
PostgreSQL, Redis, APM, CI/CD, vector databases, model serving frameworks, LLM
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Palo Alto, California, United States
$189k-$283k/yr OnsiteFull Time
2+ YOEBachelor's in a technical field required, 2+ years production ML experience, proficiency in Python and PyTorch, experience training/fine-tuning/distilling language models, serving low-latency models, and building closed-loop data and evaluation pipelines.
Python, PyTorch, vLLM, SGLang, TensorRT-LLM, LoRA, DPO, RLAIF, RLHF, GRPO, FP8, INT8, KV-cache, MCP, LiteLLM, Google ADK, Azure AI Foundry, Vertex AI
3d
Save
Mark Applied
Hide
Site Reliability Engineer, Cloud
Santa Clara, California, United States
$116k-$219k/yr OnsiteFull Time
3+ YOE3+ years supporting live-site production environments, SRE on-call experience, strong Python/Java scripting, Kubernetes and AWS expertise, experience with ML model serving and MLOps frameworks.
Python, Java, Kubernetes, MLflow, Kubeflow, Airflow, AWS SageMaker, AWS, FastAPI, Triton, TorchServe, Akamai Edge Redirector Cloudlets, Akamai Cloudlets Policy Manager, Akamai CDN
2mo
Save
Mark Applied
Hide
Distributed Systems Engineer 6 - Decisioning & Optimization
New York City or Seattle or Los Angeles or Los Gatos
$499k-$900k/yr OnsiteFull Time
10+ YOE10+ years building large-scale distributed systems (3+ years in ads); expertise in ML model serving with sub-20ms P99, ad serving/bidding/pacing systems, API and platform design, technical leadership, and cross-functional collaboration.
1mo
Save
Mark Applied
Hide
Machine Learning Engineer 5 - Decisioning & Optimization
New York or Los Angeles or Los Gatos or Seattle
$466k-$750k/yr OnsiteFull Time
7+ YOE7+ years software engineering; 3+ years ML infrastructure, model serving, or ML platform experience in ads/real-time decisioning; real-time model serving with sub-20ms latency; proficiency in Java, Python, or Scala; experience with ML serving frameworks and real-time feature pipelines; strong model monitoring and production readiness.
Java, Python, Scala, ML serving frameworks, feature stores, model registries
3w
Save
Mark Applied
Hide
Software Development Engineer II (Planning and Forecasting)
Palo Alto, California, United States
$162k-$182k/yr OnsiteFull Time
2+ YOE2-4 years production software engineering experience; strong fundamentals in data structures and algorithms; experience with data pipelines, APIs, and model-serving; AI-native engineering practice; Bachelor's in CS/Engineering or equivalent experience.
Google Meet, Zoom
3w
Save
Mark Applied
Hide
Principal Machine Learning Engineer
Seattle or United States or Redwood City or Santa Clara or Austin
$135k-$306k/yr OnsiteFull Time
10+ YOE10+ years experience building and operating large-scale AI model training, fine-tuning, and serving systems; expertise in model architecture analysis, benchmarking, troubleshooting, and mentoring teams.
vLLM, SGLang, Python, Pytorch, OCI
3w
Save
Mark Applied
Hide
Sr Machine Learning Services Engineer
San Jose, California, United States
$152k-$265k/yr OnsiteFull Time
5+ YOE5+ years building and operating ML systems with GPU workloads, designing large-scale cloud services, optimizing model inference, and collaborating with research and engineering teams; proficiency with Python, PyTorch/TensorFlow, model serving tools, containerization, orchestration, and AWS.
Python, PyTorch, TensorFlow, NVIDIA Triton, TorchServe, ONNX, AIT, AOT, CUDA, Docker, Kubernetes, AWS
2w
Save
Mark Applied
Hide
Sr. Machine Learning Engineer, Infrastructure
Mountain View or Bellevue or San Francisco
$210k-$316k/yr OnsiteFull Time
Experience building and operating ML infrastructure and model serving systems; proficiency in Golang or Python; Kubernetes experience; familiarity with ML serving frameworks and distributed systems; strong collaboration and communication.
Golang, Python, Kubernetes, Ray Serve, Triton, TorchServe, Terraform, Prometheus, Grafana, OpenTelemetry
1w
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Palo Alto, California, United States
$149k-$306k/yr HybridFull Time
7+ YOEMaster's in Software Engineering, 7+ years development experience, 3+ years with SAP BTP & SAP AI Core, strong Java/Python/NodeJs skills, Docker/Kubernetes, ML model serving, PyTorch or TensorFlow, SQL/Postgres, CI/CD and cloud experience.
SAP BTP, SAP AI Core, SAP GenAI Hub, Java, Python, NodeJs, Docker, Kubernetes, PyTorch, TensorFlow, Git, SQL, Postgres, AWS, GCP, Azure, ReactJS, SAP UI5, CI/CD
1mo
Save
Mark Applied
Hide
(USA) Distinguished, Software Engineer
Bentonville or Sunnyvale
$130k-$260k/yr OnsiteFull Time
10+ YOE10+ years building and operating large-scale distributed systems; deep AI/ML systems and model-serving experience; cloud-native platform and observability expertise; strong communication and technical leadership.
JSON Schema, OpenAPI, Pydantic, protobuf, WCAG 2.2, CI/CD
2w
Save
Mark Applied
Hide
DevOps, MLOps & Security Engineering Lead
San Jose, California, United States
$140k-$170k/yr HybridFull Time
Engineering leader with hands-on DevSecOps experience across AWS and GCP, CI/CD and IaC expertise, AI infrastructure (GPU/compute provisioning, model serving), cloud security, and scripting in Python/Bash/Go/Java.
AWS, GCP, SageMaker, Vertex AI, EKS, GKE, Python, Bash, Go, Java
2w
Save
Mark Applied
Hide
Sr. Staff Software Engineer, Systems Infrastructure
Sunnyvale or Mountain View
$198k-$326k/yr HybridFull Time
LinkedInNASDAQ: MSFT: Professional social network for career development and job recruitment.
8+ YOEBA/BS or equivalent; 8+ years engineering experience building large-scale ML/model serving and GPU systems; experience with CUDA, PyTorch/TensorFlow, C++/Go/Python/Java; strong systems and performance optimization skills.
SGLang, vLLM, Triton, TensorRT, Ray, XLA, TVM, PyTorch, TensorFlow, CUDA, C++, Go, Python, Java
1mo
Save
Mark Applied
Hide
Principal AI Research Engineer
Bengaluru or Noida or Mountain View
HybridFull Time
6+ YOE6+ years applying ML/AI in production, deep learning and LLM expertise, Python and PyTorch proficiency, experience training/serving large models, distributed training, strong communication and technical leadership.
Python, PyTorch
2w
Save
Mark Applied
Hide
Sr. Machine Learning Engineer - Apple News
Cupertino, California, United States
OnsiteFull Time
Expertise in model serving, deployment pipelines, distributed systems, and ML platform infrastructure to build and scale ML-powered features for content tagging, ranking, and personalization.
3w
Save
Mark Applied
Hide
Sr. Staff AI Engineer - On-Prem AI Infrastructure & Agentic Systems
San Jose, California, United States
$140k-$165k/yr OnsiteFull Time
2+ YOE2+ years in AI/ML engineering with on-prem/private-cloud deployment, experience building agentic AI and RAG pipelines, model fine-tuning (LoRA/QLoRA), Python/Linux/Docker/Kubernetes proficiency, and familiarity with vector DBs and AI serving frameworks.
vLLM, TGI, Triton, Milvus, Qdrant, FAISS, Kubernetes, Helm, Docker, LangGraph, AutoGen, LoRA, QLoRA, Model Control Protocols (MCP), Python, Linux, Pinecone, Ollama, ONNX, TensorRT, GGUF, BabyAGI, LangSmith, Weights & Biases, Prometheus, Grafana, CI/CD
Explore Jobs
Expand Your Job Search
Top Cities Near Tracy for Model Serving Engineer
- Model Serving Engineer jobs in San Jose, CA
- Model Serving Engineer jobs in Oakland, CA
- Model Serving Engineer jobs in Stockton, CA
- Model Serving Engineer jobs in Fremont, CA
- Model Serving Engineer jobs in Modesto, CA
- Model Serving Engineer jobs in Elk Grove, CA
- Model Serving Engineer jobs in Hayward, CA
- Model Serving Engineer jobs in Sunnyvale, CA
- Model Serving Engineer jobs in Concord, CA
- Model Serving Engineer jobs in Santa Clara, CA
- Model Serving Engineer jobs in Berkeley, CA
- Model Serving Engineer jobs in Fairfield, CA
- Model Serving Engineer jobs in Antioch, CA
- Model Serving Engineer jobs in San Leandro, CA
- Model Serving Engineer jobs in Livermore, CA
- Model Serving Engineer jobs in Redwood City, CA
- Model Serving Engineer jobs in Mountain View, CA
- Model Serving Engineer jobs in Pleasanton, CA
- Model Serving Engineer jobs in Alameda, CA
- Model Serving Engineer jobs in Milpitas, CA