PromotedHiringCafe
ML Engineer - Inference & Model Deployment
Cupertino, CA, US
$250k-$310k/yr On-SiteFull Time
Turn powerful AI and ML models into fast, reliable production systems. Own inference latency, throughput, model-serving architecture, multi-GPU systems, and production deployment for millions of users.
Python, PyTorch, vLLM, SGLang, TensorRT, LLMs
PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
PromotedHiringCafe
Founding Backend / Infra Engineer
Cupertino, CA, US
$160k-$300k/yr On-SiteFull Time
Own the crawlers, pipelines, and infrastructure powering a real-time job search engine. Strong Node.js and Python fundamentals; bonus points for security and reverse-engineering chops.
Node.js, Python, Elasticsearch, Redis
1mo
Save
Mark Applied
Hide
Principal Engineer, Cloud Data Infrastructure
San Jose or Austin
$218k-$324k/yr HybridFull Time
10+ YOE10+ years relevant experience and a Bachelor’s degree (or equivalent); deep expertise in databases, data pipelines, messaging, caching, performance and resilience engineering; experience with real-time analytics and AI/ML infrastructure; strong technical leadership and mentoring.
3w
Save
Mark Applied
Hide
Staff Software Engineer, AI/ML Storage Infrastructure
San Jose, California, United States
$207k-$301k/yr OnsiteFull Time
8+ YOEBachelor's degree or equivalent experience; 8 years C++ programming; 5 years testing/launching software; 5 years building large-scale infrastructure or storage/compute; 3 years software design/architecture.
C++
1w
Save
Mark Applied
Hide
Software Engineer, Ads ML Infrastructure
San Jose, California, United States
$156k-$317k/yr OnsiteFull Time
3+ YOE3+ years building scalable ML systems, strong CS fundamentals, coding skills, experience with causal inference/uplift/deep learning, project management and communication skills.
1mo
Save
Mark Applied
Hide
Machine Learning Infrastructure Engineer
San Jose, California, United States
$140k-$165k/yr OnsiteFull Time
1+ YOE1–5 years software/ML infrastructure experience, strong Python, experience with AWS or GCP and production service ownership, familiarity with inference deployments, observability, telemetry, and incident response.
Python, AWS, GCP, COSMOS
1mo
Save
Mark Applied
Hide
Helix AI Engineer, Backend Infrastructure
San Jose, California, United States
$150k-$400k/yr OnsiteFull Time
5+ YOESenior backend engineer skilled in high-throughput, real-time streaming, cloud systems, and ML-serving integration.
Go, C++, Python, Rust, AWS, GCP, Azure, Docker, Kubernetes, Service Mesh, CI/CD
2w
Save
Mark Applied
Hide
Senior MLOps & AI Infrastructure Engineer
San Jose, California, United States
$149k-$216k/yr OnsiteFull Time
10+ YOEBachelor's degree, 10+ years ML engineering/MLOps experience, strong Python, cloud ML platforms (AWS/GCP/Azure), Docker/Kubernetes, CI/CD, ML frameworks (PyTorch/TensorFlow/JAX), experience with MLflow/W&B and HPC schedulers.
PyTorch, TensorFlow, JAX, Hugging Face, scikit-learn, XGBoost, MLflow, Kubeflow, Airflow, Weights & Biases, DVC, Feast, AWS SageMaker, GCP Vertex AI, Azure ML, Terraform, CloudFormation, Docker, Kubernetes, Slurm, LSF, Python, Bash, Go, SQL, Prometheus, Grafana, ELK Stack, Evidently AI, Arize
2mo
Save
Mark Applied
Hide
Sr Staff Engineer, Data Infrastructure
San Jose, California, United States
$182k-$228k/yr OnsiteFull Time
Build and scale data infrastructure for data engineering/ML; Kubernetes, Trino, Ray, MLflow; on-call; Go or Python; BS in CS/Engineering or equivalent.
Kubernetes, Trino, Ray, JupyterHub, MLflow, Vector, VictoriaMetrics, ArgoCD, Terraform
1w
Save
Mark Applied
Hide
Tech Lead Software Engineer - AI Compute Infrastructure
San Jose, California, United States
OnsiteFull Time
5+ YOE5+ years experience building cloud/ML infrastructure, strong knowledge of large-model inference, distributed systems, scheduling, and container orchestration; proficiency in Go/Rust/Python/C++.
vLLM, SGLang, TensorRT-LLM, Kubernetes, Ray, Docker, CUDA, AWS, Azure, GCP, SageMaker, Azure ML, Vertex AI, DeepSpeed, PyTorch, Go, Rust, Python, C++
3w
Save
Mark Applied
Hide
Software Engineer, ML Engineering
San Jose or Hong Kong
RemoteFull Time
3+ YOE3+ years building production ML systems or training infrastructure; proficiency in Python and one systems language (C++, C#, Java, Rust, or Go); experience with PyTorch or TensorFlow; building training pipelines, data workflows, and model deployment.
Python, C++, C#, Java, Rust, Go, PyTorch, TensorFlow, Docker
1mo
Save
Mark Applied
Hide
Director, Strategic Accounts - AI/ML Infrastructure
Maple Grove or San Jose
$120k-$200k/yr RemoteFull Time
10+ YOE10+ years in strategic account management or business development for AI/ML infrastructure; engineering degree; executive-level engagement experience.
Salesforce, CRM
2mo
Save
Mark Applied
Hide
Machine Learning Engineer, Express AI Foundations
San Jose, California, United States
$126k-$234k/yr OnsiteFull Time
3+ YOE3+ years in software engineering, backend infrastructure, data systems, ML infrastructure; distributed systems; APIs/data pipelines; Python/Java/C/C++/Go; cloud; ML systems familiarity.
Python, Java, C++, Go, Kafka, Spark, Flink, distributed data frameworks
2mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Cambridge or Richmond or McLean or New York or San Jose or San Francisco
$286k-$392k/yr RemoteFull Time
10+ YOE10+ years AI/ML engineering; Python/Go/Scala/Java; distributed compute; CPU/GPU infrastructure; ML/AI workloads.
Python, Go, Scala, Java, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda
2mo
Save
Mark Applied
Hide
Cloud Data Engineer
San Jose, California, United States
$137k-$277k/yr OnsiteFull Time
4+ YOESenior data engineer to build data pipelines, AI/ML enablement, and CI/CD infrastructure.
Python, Java, Apache Spark, Kafka, Kubernetes, Airflow
3w
Save
Mark Applied
Hide
Sr. Staff AI Engineer - On-Prem AI Infrastructure & Agentic Systems
San Jose, California, United States
$140k-$165k/yr OnsiteFull Time
2+ YOE2+ years in AI/ML engineering with on-prem/private-cloud deployment, experience building agentic AI and RAG pipelines, model fine-tuning (LoRA/QLoRA), Python/Linux/Docker/Kubernetes proficiency, and familiarity with vector DBs and AI serving frameworks.
vLLM, TGI, Triton, Milvus, Qdrant, FAISS, Kubernetes, Helm, Docker, LangGraph, AutoGen, LoRA, QLoRA, Model Control Protocols (MCP), Python, Linux, Pinecone, Ollama, ONNX, TensorRT, GGUF, BabyAGI, LangSmith, Weights & Biases, Prometheus, Grafana, CI/CD
1d
Save
Mark Applied
Hide
Sr. Machine Learning Engineer
San Jose, California, United States
$194k-$246k/yr HybridFull Time
3+ YOEMaster's in CS/control engineering plus 3 years (or Bachelor's plus 5 years). Experience with LLM fine-tuning, prompt engineering, agent frameworks, production ML/MLOps, distributed training, cloud GPU infrastructure, and Python.
PyTorch, DeepSpeed, Accelerate, FSDP, CrewAI, AutoGen, LangGraph, ReAct, vLLM, Ray Serve, Triton, Cosmos, Docker, Python, A100, H100, Electronic Medical Records (EMR)
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Austin or San Jose or United States or Canada or Mexico
HybridFull Time
8+ YOE8+ years in DevOps/SRE or ML infrastructure (4+ supporting ML), strong Python/Scala/Java, Kubernetes on GCP/AWS, CI/CD, Terraform, Spark/Flink/Airflow/Kafka, MLflow/Chronon, observability tools, and on-call experience.
Python, Scala, Java, GCP, AWS, GKE, EKS, Kubernetes, Apache Airflow, Apache Spark, Ray, MLflow, Chronon, Aerospike, Apache Flink, Kafka, Jenkins, GitLab Runner, Terraform, Prometheus, Grafana, Datadog
1mo
Save
Mark Applied
Hide
Director of Product Management – AI Essentials
Spring or San Jose or Durham or Fort Collins or Andover
$170k-$413k/yr HybridFull Time
15+ YOE5+ MgmtBachelor's in CS/engineering required; 15+ years product experience with 5+ years leading product teams in AI/ML or data infrastructure. Experience with AI platforms, model serving, GPU ecosystems, GTM and monetization.
GenAI, GPU, MLOps, GreenLake, AI tools, AI/ML, SaaS, DevOps, agent frameworks
Explore Jobs