PromotedHiringCafe
ML Engineer - Inference & Model Deployment
Cupertino, CA, US
$250k-$310k/yr On-SiteFull Time
Turn powerful AI and ML models into fast, reliable production systems. Own inference latency, throughput, model-serving architecture, multi-GPU systems, and production deployment for millions of users.
Python, PyTorch, vLLM, SGLang, TensorRT, LLMs
4w
Save
Mark Applied
Hide
Software Engineer, ML Serving
San Francisco, California, United States
HybridFull Time
Hands-on experience with real-time multinode ML serving, distributed model serving, Linux internals, networking, containerization (Docker, Kubernetes), IaC (Terraform, Packer), and on-call/production reliability responsibilities.
NVIDIA Dynamo, Triton, vLLM, SGLang, DDP, FSDP, Linux, Docker, Kubernetes, Terraform, Packer, gRPC, WebRTC, WebSockets, Ansible, Chef, Puppet, AWS, GCP, OCI, Hopper, Blackwell
1mo
Save
Mark Applied
Hide
Member of Technical Staff — Model Optimization and Inference
Seattle, Washington, United States
$250k-$350k/yr OnsiteFull Time
Deep expertise in LLM and diffusion-model inference optimization, KV cache strategies, quantization (INT8/INT4, GPTQ/AWQ), profiling/benchmarking, and strong Python/PyTorch skills; familiarity with CUDA/Triton and inference-serving frameworks.
vLLM, SGLang, TensorRT-LLM, Python, PyTorch, CUDA, Triton
3mo
Save
Mark Applied
Hide
Staff / Principal Machine Learning Engineer, Serving - USA
Mountain View, California, United States
$270k-$500k/yr HybridFull Time
Inference optimization, model acceleration, high-performance systems, distributed systems, and production ML serving. PhD or equivalent experience.
C++, CUDA, Rust, Python, Kubernetes, Ray
2mo
Save
Mark Applied
Hide
AI Engineer - Model Performance
San Francisco, California, United States
HybridFull Time
Deep experience with LLM serving frameworks, quantization, and production fine-tuning; strong Python and GPU performance analysis.
Python, PyTorch, vLLM, SGLang, TensorRT-LLM, LoRA, QLoRA, torchtune, Axolotl
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer, Ad Serving
New York or San Jose
$195k-$408k/yr HybridFull Time
10+ YOE10+ years applying machine learning and optimization to production systems; deep statistics/ML expertise; production ML lifecycle experience (feature engineering, model serving, monitoring); strong software skills in Python, SQL, Java/Scala; excellent communication.
Python, SQL, Java/Scala
6d
Save
Mark Applied
Hide
Senior Machine Learning Engineer, Model Serving Infrastructure (Multiple Positions)
San Jose, California, United States
$265k-$388k/yr OnsiteFull Time
2+ YOEMaster's (plus 2 years) or Bachelor's (plus 5 years) in a quantitative field; 2+ years coding in Python or C++; Linux development experience; ML, system design, and production deployment experience.
Python, C++, Linux
5h
Save
Mark Applied
Hide
Staff Software Engineer, Foundation Model API
San Francisco or Mountain View
$190k-$265k/yr OnsiteFull Time
8+ YOE8+ years backend/infrastructure experience, distributed systems, scalable APIs, cloud-native infra, real-time serving/ML infra/GPU orchestration, strong Scala/Go/Python skills, product ownership and customer engagement.
OpenAI, Anthropic, Gemini, Qwen, GPT-OSS, Llama, SageMaker, Vertex AI, Azure ML, FMAPI, Apache Spark™, Delta Lake, MLflow, Scala, Go, Python
3mo
Save
Mark Applied
Hide
Software Engineer, Model Routing & Inference
New York or San Francisco
OnsiteFull Time
Experience building high-throughput, low-latency distributed systems; inference serving; traffic routing; production software delivery; cost-performance tradeoffs.
1w
Save
Mark Applied
Hide
Staff, MLOps Engineer
New York City or San Francisco or United States
$220k-$280k/yr RemoteFull Time
Sequen AI: AI-native ranking engine for enterprise search and recommendations.
4+ YOEMinimum 4+ years MLOps or ML/platform engineering; expertise with low-latency model serving, Python and PyTorch; cloud (AWS/GCP/Azure), Docker, Kubernetes, MLflow; strong distributed systems and pipeline experience.
Python, PyTorch, AWS, GCP, Azure, Docker, Kubernetes, MLflow, Rust, vLLM, Triton
1mo
Save
Mark Applied
Hide
Machine Learning & Data Platform Engineer
Richardson, Texas, United States
$107k-$183k/yr OnsiteFull Time
5+ YOE5+ years Python/ML engineering experience; NLP and transformer model fine-tuning; production ETL and data pipeline experience; PostgreSQL/SQLAlchemy and pandas/NumPy proficiency; experience serving ML models and mentoring engineers.
Wallaroo, BERT, Hugging Face, Hugging Face Transformers, TensorFlow, Python, pandas, NumPy, SQLAlchemy, PostgreSQL, SageMaker, Vertex AI, Paramiko, openpyxl, xlrd, REST APIs, OAuth2, JWT, Data Management Gateway (DMG)
3d
Save
Mark Applied
Hide
Senior Machine Learning Engineer, Ads Content Understanding
United States
$217k-$303k/yr RemoteFull Time
5+ YOE5+ years building production ML systems (models+pipelines+serving), senior technical leadership, experience shipping NLP/content understanding models, strong software engineering and ML intuition.
PyTorch, TensorFlow, Python, Go, Java, C++
2mo
Save
Mark Applied
Hide
Machine Learning Engineer, Inference & Serving (Speech LLM) - San Francisco
San Francisco, California, United States
$180k-$270k/yr HybridFull Time
Experience building and deploying high-throughput, ultra-low-latency inference for LLMs or speech models; optimize latency/throughput; manage KV cache; understand GPU memory hierarchies; collaborate across ML and backend teams.
vLLM, TensorRT-LLM, SGLang, NVIDIA Triton Inference Server, WebSockets, WebRTC, CUDA, PTQ, FP8, INT8, AWQ, GPTQ, Tensor Parallelism, Kubernetes
1mo
Save
Mark Applied
Hide
Infrastructure Engineer
Redwood City, California, United States
HybridFull Time
8+ YOE8+ years in infrastructure/DevOps/SRE; strong cloud expertise; experience with CI/CD, PostgreSQL, Redis, APM, model serving, vector databases, GPU optimization, and LLM deployment.
PostgreSQL, Redis, APM, CI/CD, vector databases, model serving frameworks, LLM
2w
Save
Mark Applied
Hide
Distinguished AI Engineer - Onsite in Jersey City, NJ
Jersey City, New Jersey, United States
$140k-$210k/yr OnsiteFull Time
10+ YOE10+ years in AI/ML systems or platform engineering; deep experience with LLMs, RAG, embeddings, model serving, LLMOps/MLOps, GPU/inference optimization, governance, and stakeholder engagement.
LLMs, LLMOps, MLOps, RAG, embeddings, AI gateways, model-serving, model hubs, agent frameworks, orchestration layers, GPU, evaluation frameworks, observability
1w
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer
Austin or Reston or United States
HybridFull Time
5+ YOE5–8 years building distributed systems or cloud/platform services; production Kubernetes and ML infra experience; strong software engineering in Python and Go/Rust/C++; familiarity with GPU inference, model serving frameworks, and cloud platforms.
Kubernetes, Helm, Argo CD, Docker, Prometheus, Grafana, OpenTelemetry, Python, Go, Rust, C++, vLLM, SGLang, TensorRT-LLM, Triton Inference Server, Ray Serve, AWS, Azure, Oracle Cloud Infrastructure, Google Cloud Platform
1mo
Save
Mark Applied
Hide
Staff Machine Learning Engineer
San Francisco or Minneapolis
HybridFull Time
5+ YOE5+ years of machine learning and backend software engineering; backend in Go/Java and Python; embeddings, similarity search, ranking models; ML pipelines; distributed systems; SQL/NoSQL; API serving; A/B testing.
Go, Java, Python, MLflow, Kubeflow, Airflow, REST, gRPC, Model servers, SQL, NoSQL
3w
Save
Mark Applied
Hide
Staff Data Engineer (Dallas, TX, US)
Dallas, Texas, United States
OnsiteFull Time
5+ YOEBuild and operate MLOps platform on Azure and Databricks; strong Python and SQL; experience with MLflow, model serving, CI/CD, IaC (Terraform/Bicep), Docker/Kubernetes; 5+ years engineering experience with 3+ years on ML pipelines.
Azure, Databricks, MLflow, Databricks Model Serving, Azure Machine Learning, AKS, Azure DevOps, Data Factory, Unity Catalog, Workflows, Model Registry, Python, SQL, PyTorch, Scikit-learn, XGBoost, Terraform, Bicep, GitHub Actions, Docker, Kubernetes, Evidently AI, Azure Monitor, Grafana
2mo
Save
Mark Applied
Hide
Distributed Systems Engineer 5 - Decisioning & Optimization
New York or Los Angeles or Los Gatos or Seattle
$388k-$619k/yr OnsiteFull Time
7+ YOE7+ years building distributed systems; ads domain experience; ML model serving; backend APIs and ad tech systems; low-latency serving; collaboration across teams.
ML model serving, real-time inference, APIs, ad servers, bidders, pacing, routing, calibration serving
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Palo Alto, California, United States
$189k-$283k/yr OnsiteFull Time
2+ YOEBachelor's in a technical field required, 2+ years production ML experience, proficiency in Python and PyTorch, experience training/fine-tuning/distilling language models, serving low-latency models, and building closed-loop data and evaluation pipelines.
Python, PyTorch, vLLM, SGLang, TensorRT-LLM, LoRA, DPO, RLAIF, RLHF, GRPO, FP8, INT8, KV-cache, MCP, LiteLLM, Google ADK, Azure AI Foundry, Vertex AI
4w
Save
Mark Applied
Hide
Staff ML/LLM Ops Engineer
Seattle, Washington, United States
$213k-$272k/yr OnsiteFull Time
8+ YOE8+ years in ML-infrastructure/MLOps building and operating model deployment, serving, CI/CD, monitoring, and LLM/VLM ops; strong API design and technical leadership; BS/MS in CS/Engineering or equivalent experience.
Kubernetes, Argo, LangGraph, MCP, NVIDIA Jetson, vector databases
Explore Jobs