PromotedHiringCafe
ML Engineer - Inference & Model Deployment
Cupertino, CA, US
$250k-$310k/yr On-SiteFull Time
Turn powerful AI and ML models into fast, reliable production systems. Own inference latency, throughput, model-serving architecture, multi-GPU systems, and production deployment for millions of users.
Python, PyTorch, vLLM, SGLang, TensorRT, LLMs
1mo
Save
Mark Applied
Hide
Member of Technical Staff — Model Optimization and Inference
Seattle, Washington, United States
$250k-$350k/yr OnsiteFull Time
Deep expertise in LLM and diffusion-model inference optimization, KV cache strategies, quantization (INT8/INT4, GPTQ/AWQ), profiling/benchmarking, and strong Python/PyTorch skills; familiarity with CUDA/Triton and inference-serving frameworks.
vLLM, SGLang, TensorRT-LLM, Python, PyTorch, CUDA, Triton
2mo
Save
Mark Applied
Hide
Distributed Systems Engineer 5 - Decisioning & Optimization
New York or Los Angeles or Los Gatos or Seattle
$388k-$619k/yr OnsiteFull Time
7+ YOE7+ years building distributed systems; ads domain experience; ML model serving; backend APIs and ad tech systems; low-latency serving; collaboration across teams.
ML model serving, real-time inference, APIs, ad servers, bidders, pacing, routing, calibration serving
4w
Save
Mark Applied
Hide
Staff ML/LLM Ops Engineer
Seattle, Washington, United States
$213k-$272k/yr OnsiteFull Time
8+ YOE8+ years in ML-infrastructure/MLOps building and operating model deployment, serving, CI/CD, monitoring, and LLM/VLM ops; strong API design and technical leadership; BS/MS in CS/Engineering or equivalent experience.
Kubernetes, Argo, LangGraph, MCP, NVIDIA Jetson, vector databases
2mo
Save
Mark Applied
Hide
Distributed Systems Engineer 6 - Decisioning & Optimization
New York or Los Angeles or Los Gatos or Seattle
$499k-$900k/yr OnsiteFull Time
10+ YOE10+ years distributed systems, 3+ years ads domain; ML model serving; backend systems; architectural leadership; production deployment.
Distributed systems, ML model serving, Ad tech systems, APIs, infrastructure
2mo
Save
Mark Applied
Hide
Distributed Systems Engineer 6 - Decisioning & Optimization
New York City or Seattle or Los Angeles or Los Gatos
$499k-$900k/yr OnsiteFull Time
10+ YOE10+ years building large-scale distributed systems (3+ years in ads); expertise in ML model serving with sub-20ms P99, ad serving/bidding/pacing systems, API and platform design, technical leadership, and cross-functional collaboration.
1mo
Save
Mark Applied
Hide
Machine Learning Engineer 5 - Decisioning & Optimization
New York City or Seattle or Los Angeles or Los Gatos
$466k-$750k/yr OnsiteFull Time
7+ YOE7+ years software engineering experience with 3+ years on ML infrastructure or model serving; proficiency in Java, Python, or Scala; experience building high‑QPS, low‑latency model serving, feature serving, and model monitoring.
Java, Python, Scala, Chronon, Signal Service, JVM
1mo
Save
Mark Applied
Hide
Machine Learning Engineer 5 - Decisioning & Optimization
New York or Los Angeles or Los Gatos or Seattle
$466k-$750k/yr OnsiteFull Time
7+ YOE7+ years software engineering; 3+ years ML infrastructure, model serving, or ML platform experience in ads/real-time decisioning; real-time model serving with sub-20ms latency; proficiency in Java, Python, or Scala; experience with ML serving frameworks and real-time feature pipelines; strong model monitoring and production readiness.
Java, Python, Scala, ML serving frameworks, feature stores, model registries
3w
Save
Mark Applied
Hide
Principal Machine Learning Engineer
Seattle or United States or Redwood City or Santa Clara or Austin
$135k-$306k/yr OnsiteFull Time
10+ YOE10+ years experience building and operating large-scale AI model training, fine-tuning, and serving systems; expertise in model architecture analysis, benchmarking, troubleshooting, and mentoring teams.
vLLM, SGLang, Python, Pytorch, OCI
2w
Save
Mark Applied
Hide
Sr. Machine Learning Engineer, Infrastructure
Mountain View or Bellevue or San Francisco
$210k-$316k/yr OnsiteFull Time
Experience building and operating ML infrastructure and model serving systems; proficiency in Golang or Python; Kubernetes experience; familiarity with ML serving frameworks and distributed systems; strong collaboration and communication.
Golang, Python, Kubernetes, Ray Serve, Triton, TorchServe, Terraform, Prometheus, Grafana, OpenTelemetry
2mo
Save
Mark Applied
Hide
Machine Learning Engineer, Ad Response Prediction
Seattle, Washington, United States
$144k-$194k/yr OnsiteFull Time
3+ YOE3+ years software development; experience building scalable ML pipelines and online serving systems; proficiency in C#, C++, Java, or Perl; knowledge of ML model architectures.
C#, C++, Java, Perl, JAX, PyTorch, vLLM, SGLang, Dynamo, TorchXLA, TensorRT
1d
Save
Mark Applied
Hide
Head of AI & Agentic Platform Engineering
New York City or La Jolla or Bothell or Collegeville or Walton Oaks or Tampa or Dublin or Sandwich or Groton or Thessaloniki or Berlin
$300k-$500k/yr HybridFull Time
12+ YOE7+ Mgmt12+ years software/infrastructure engineering with 7+ years in AI/ML platform or MLOps at scale; deep experience with multi-tenant AI infrastructure, LLM gateway, model serving, compute provisioning, IaC (Terraform), multi-cloud, security, and regulated environments (GxP).
Terraform, Azure, AWS, GCP, SLURM, LSF
4w
Save
Mark Applied
Hide
Director of Data
United States or Canada or San Francisco or New York City or Seattle or Boston or Chicago or Denver or Austin or Portland
$195k-$358k/yr RemoteFull Time
10+ YOE5+ Mgmt10+ years in data/analytics/engineering roles, 5+ years managing data or analytics teams, strong SQL/dbt/data modeling skills, experience with Redshift, self-serve analytics tools, experimentation, and stakeholder communication.
Redshift, dbt, Opensearch, Omni, Amplitude, Statsig, Looker, Mode, Hex, SQL, Covey Scout
2w
Save
Mark Applied
Hide
Solution Specialist, AI Runtime Services
Livingston or New York or Sunnyvale or San Francisco or Bellevue
$207k-$275k/yr OnsiteFull Time
10+ YOE10+ years in distributed systems/ML infrastructure or production AI engineering; 5+ years with AI runtime systems; expertise in model serving, batching, execution isolation, GPU memory management, and Kubernetes; strong customer-facing and commercial skills.
vLLM, TensorRT-LLM, TGI, Triton, Kubernetes, Inference, Sandboxes