PromotedHiringCafe
ML Engineer - Inference & Model Deployment
Cupertino, CA, US
$250k-$310k/yr On-SiteFull Time
Turn powerful AI and ML models into fast, reliable production systems. Own inference latency, throughput, model-serving architecture, multi-GPU systems, and production deployment for millions of users.
Python, PyTorch, vLLM, SGLang, TensorRT, LLMs
PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
PromotedHiringCafe
Founding Backend / Infra Engineer
Cupertino, CA, US
$160k-$300k/yr On-SiteFull Time
Own the crawlers, pipelines, and infrastructure powering a real-time job search engine. Strong Node.js and Python fundamentals; bonus points for security and reverse-engineering chops.
Node.js, Python, Elasticsearch, Redis
3mo
Save
Mark Applied
Hide
Senior ML Infrastructure Engineer, Proactive
Cupertino or Seattle
OnsiteFull Time
Experience designing large-scale ML/AI platforms; proficiency in ML systems, LLMs, and distributed data; strong multi-threaded programming skills.
Python, Distributed systems, MacOS/iOS development, LLMs, Machine learning platforms
1mo
Save
Mark Applied
Hide
ML Engineer
Palo Alto or Seattle or Paris
$139k-$226k/yr RemoteFull Time
5+ YOE5+ years applied ML/AI experience, 4+ years software engineering, experience with LLM-based systems, model lifecycle and ML infrastructure, bachelor's in CS/Engineering or equivalent, strong communication and mentoring skills.
Docker Desktop, Docker Hub, Docker Scout, LLM, MCP, Agentic Platform
1w
Save
Mark Applied
Hide
Sr. Mgr., ML Infrastructure, PV Personalization and Discovery
Sunnyvale or Seattle or New York
$242k-$328k/yr OnsiteFull Time
10+ YOE5+ Mgmt10+ years engineering experience, 5+ years managing engineering teams, expertise in ML infrastructure, retrieval/recommendation systems, LLMs/generative AI, partnering with applied scientists, experience delivering large-scale consumer software.
AWS
4w
Save
Mark Applied
Hide
Staff ML/LLM Ops Engineer
Seattle, Washington, United States
$213k-$272k/yr OnsiteFull Time
8+ YOE8+ years in ML-infrastructure/MLOps building and operating model deployment, serving, CI/CD, monitoring, and LLM/VLM ops; strong API design and technical leadership; BS/MS in CS/Engineering or equivalent experience.
Kubernetes, Argo, LangGraph, MCP, NVIDIA Jetson, vector databases
1w
Save
Mark Applied
Hide
Machine Learning Infrastructure Engineer
San Francisco or New York or Los Angeles or Seattle
$200k-$345k/yr HybridFull Time
4+ YOE4+ years building ML systems,3+ years software engineering,1+ year Python,experience with databases,monitoring,cloud services and production ML deployments.
Python, PostgreSQL, DynamoDB, Elasticsearch, Redis, DataDog, Grafana, AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS, ECS, Apache Kafka, Flink
2mo
Save
Mark Applied
Hide
SWE - Backend Infrastructure Engineer
San Francisco or Bellevue or New York
$175k-$280k/yr OnsiteFull Time
3+ YOEStrong systems thinker with reliability engineering experience; 3+ years in infrastructure, platform, or ML systems; Kubernetes production experience; strong communication.
Kubernetes, Terraform, CloudFormation, Pulumi, TorchServe, Seldon, KServe, Ray Serve, PyTorch, APIs, Database design
1mo
Save
Mark Applied
Hide
Software Engineer, Systems ML
Bellevue or Menlo Park or New York
$184k-$257k/yr OnsiteFull Time
8+ YOEBachelor's or equivalent, 8+ years in systems engineering/ML infrastructure, experience with distributed ML training/inference, PyTorch/JAX/TensorFlow, low-level C++/CUDA optimizations, and leading cross-functional ML systems projects.
PyTorch, JAX, TensorFlow, C++, CUDA, MLIR, XLA, TVM, Triton
3mo
Save
Mark Applied
Hide
Senior AI/ML Capacity and Performance Engineer
Sunnyvale or Seattle
$145k-$261k/yr HybridFull Time
5+ YOE5+ years in high-scale infrastructure or ML systems; BS in Computer Science or related field; strong Python and PyTorch; Kubernetes; cloud experience; GPU/ML infra focus.
Python, PyTorch, Kubernetes, Nvidia DCGM, nvidia-smi, Grafana, AWS, GCP, Azure, BigQuery, Hugging Face, Nvidia Nsight, Nsight Compute
1d
Save
Mark Applied
Hide
Member of Technical Staff - Machine Learning Infrastructure Engineer
San Francisco or Toronto or Seattle
$180k-$300k/yr OnsiteFull Time
Experienced software engineer with production ML/data infrastructure skills, proficiency with PyTorch or JAX, distributed systems, AWS/GCP, Kubernetes, data pipelines, and familiarity with transformers and inference libraries like vLLM.
PyTorch, JAX, AWS, GCP, Kubernetes, transformers, vLLM, SGLang
1mo
Save
Mark Applied
Hide
Staff Software Engineer - ML Platform
San Francisco or Seattle or New York City
$217k-$289k/yr HybridFull Time
Proven experience designing and building real-time ML systems and infrastructure (feature stores, real-time serving, deployment safety, monitoring). Strong backend engineering, Terraform experience, technical leadership, and cross-team partnership.
Terraform, Gem, One Medical, Headspace, Talkspace
2w
Save
Mark Applied
Hide
Manager, Software Engineering, ML Inference
Palo Alto or Bellevue or Los Angeles
$229k-$343k/yr OnsiteFull Time
9+ YOE1+ Mgmt9+ years software engineering experience, 1+ year managing engineers, experience with large-scale ML infrastructure, distributed systems, strong communication and technical leadership, proficiency with ML training/inference platforms and AI tools.
TensorFlow, PyTorch, Caffe2, Spark ML, Spark, Flink, Ray, Kubernetes, NoSQL, Memcache, Redis, Kafka, Google Cloud, AWS
1mo
Save
Mark Applied
Hide
Principal Infrastructure Architect
Seattle, Washington, United States
$184k-$231k/yr HybridFull Time
10+ YOE10+ years in server/storage/infrastructure architecture; deep expertise with CPU/GPU/xPU platforms, AI/ML hardware roadmaps, CXL/DPUs/SmartNICs and storage topologies; strong communication and leadership.
CXL memory pooling, DPUs/SmartNICs, disaggregated storage, computational storage, CPU, GPU, xPU, AI/ML, 800VDC rack scale systems
1w
Save
Mark Applied
Hide
Software Engineer - AI Compute Infrastructure
Seattle, Washington, United States
OnsiteFull Time
2+ YOE2+ years building cloud/ML infrastructure; strong knowledge of large-model inference, distributed systems, scheduling, and container orchestration; proficiency in Go, Rust, Python, or C++; experience with Kubernetes and GPU orchestration.
AIBrix, Kubernetes, vLLM, SGLang, TensorRT-LLM, Docker, Ray, Go, Rust, Python, C++, CUDA, AWS, Azure, GCP, SageMaker, Azure ML, Vertex AI, DeepSpeed, PyTorch
1mo
Save
Mark Applied
Hide
Senior Software Engineering Manager, AI/ML, Compute Infrastructure
Seattle, Washington, United States
$262k-$365k/yr OnsiteFull Time
8+ YOE5+ MgmtBachelor's degree or equivalent, 8+ years software development, 7+ years leading ML/ML infrastructure strategy, 5+ years people management, experience with speech/audio or reinforcement learning or ML infrastructure, cloud GPU experience preferred.
Google Compute Engine (GCE), Vertex AI, Google Cloud, TPU, GPU
1mo
Save
Mark Applied
Hide
Software Engineer, ML Platform
Seattle, Washington, United States
$140k-$215k/yr OnsiteFull Time
5+ YOE5+ years building and deploying ML systems, strong Python skills, experience with ML training infrastructure, Terraform/Ansible, PyTorch/JAX, and leading technical projects; degree in CS/ML/Computational Biology preferred.
Python, Terraform, Ansible, PyTorch, JAX, Slurm, Kubernetes
3w
Save
Mark Applied
Hide
Staff Software Engineer, ML Infrastructure, Level 6
Bellevue or Seattle or Palo Alto
$229k-$343k/yr OnsiteFull Time
9+ YOE9+ years post-Bachelor's software development experience (or advanced degree with reduced experience), experience building large-scale ML, distributed systems or big data processing, proficiency in Python/Java/Scala/C++, strong systems and scalability skills.
Python, Java, Scala, C++, Spark, Flink, Ray, PyTorch, TensorFlow
2mo
Save
Mark Applied
Hide
Principal AI and ML Infra Software Engineer, GPU Clusters
Santa Clara or Redmond
$272k-$431k/yr OnsiteFull Time
15+ YOEBS in Computer Science or equivalent experience; 15+ years in AI/ML and HPC; hands-on HPC and accelerated computing (GPU), storage (Lustre, GPFS, BeeGFS), schedulers (Slurm, Kubernetes, LSF), networking (Infiniband, RoCE, Amazon EFA), containers (Docker, Enroot); PyTorch/NeMo/JAX; Python, Go, Bash; cloud experience.
Lustre, GPFS, BeeGFS, Slurm, Kubernetes, LSF, Infiniband, RoCE, Amazon EFA, Docker, Enroot, PyTorch, NeMo, JAX, Python, Go, Bash, AWS, GCP, Azure
1w
Save
Mark Applied
Hide
Software Engineer, Recommendation Infrastructure (Seattle)
Seattle, Washington, United States
$148k-$301k/yr OnsiteFull Time
3+ YOEBachelor's in CS or related,3-5 years building scalable systems,experience with C/C++,Java or Golang,knowledge of recommender/search/ML/distributed systems,strong communication and ownership.
C, C++, Java, Golang
1mo
Save
Mark Applied
Hide
Manager, Engineering | ML Infrastructure & Tooling
Seattle, Washington, United States
$170k-$195k/yr HybridFull Time
7+ YOE3+ MgmtBS in CS or related, 7+ years software development experience with 3+ years managing teams; experience delivering machine-learning cloud infrastructure, infra-as-code, DB/SQL performance, CI/CD/DevOps, familiarity with LLMs/clustering/anomaly detection, and agile practices.
SQL, CI/CD, DevOps, LLMs, Agile, infrastructure as code
2w
Save
Mark Applied
Hide
Sr. Machine Learning Engineer, Infrastructure
Mountain View or Bellevue or San Francisco
$210k-$316k/yr OnsiteFull Time
Experience building and operating ML infrastructure and model serving systems; proficiency in Golang or Python; Kubernetes experience; familiarity with ML serving frameworks and distributed systems; strong collaboration and communication.
Golang, Python, Kubernetes, Ray Serve, Triton, TorchServe, Terraform, Prometheus, Grafana, OpenTelemetry
Explore Jobs