PromotedHiringCafe
ML Engineer - Inference & Model Deployment
Cupertino, CA, US
$250k-$310k/yr On-SiteFull Time
Turn powerful AI and ML models into fast, reliable production systems. Own inference latency, throughput, model-serving architecture, multi-GPU systems, and production deployment for millions of users.
Python, PyTorch, vLLM, SGLang, TensorRT, LLMs
PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
PromotedHiringCafe
Founding Backend / Infra Engineer
Cupertino, CA, US
$160k-$300k/yr On-SiteFull Time
Own the crawlers, pipelines, and infrastructure powering a real-time job search engine. Strong Node.js and Python fundamentals; bonus points for security and reverse-engineering chops.
Node.js, Python, Elasticsearch, Redis
1w
Save
Mark Applied
Hide
AI Infrastructure Engineer
San Jose, California, United States
$45k-$121k/yr OnsiteFull Time
3+ YOEDesign and build hybrid AI infrastructure integrating compute, GPU nodes, software-defined storage, Kubernetes, IaC, and observability; 3+ years experience in AI infrastructure or related roles.
NC2, Objects (S3-compatible), Kubernetes, Calm, Terraform, Prometheus, Grafana, ELK, OpenTelemetry, AOS, AHV, Cloud Manager (NCM)
1mo
Save
Mark Applied
Hide
AI Infrastructure Engineer
San Jose, California, United States
$192k-$250k/yr OnsiteFull Time
5+ YOE5+ years building and optimizing large-scale LLM/VLM inference systems; strong C/C++ and performance engineering skills; GPU/NPU programming (CUDA), PyTorch/TensorFlow, and BS/MS in CS/CE or related field required.
CUDA, PyTorch, TensorFlow, C/C++, AIOS
3mo
Save
Mark Applied
Hide
AI Training Infrastructure Engineer – Humanoid Whole Body Control
San Jose, California, United States
$200k-$300k/yr OnsiteFull Time
Proficient in Python and PyTorch; experience with robotics training infra; knowledge of physics engines; RL/IL; dynamics and controls.
Python, PyTorch, NVIDIA PhysX, MuJoCo, Warp, PyBullet, Robotics simulation tools
2w
Save
Mark Applied
Hide
Senior MLOps & AI Infrastructure Engineer
San Jose, California, United States
$149k-$216k/yr OnsiteFull Time
10+ YOEBachelor's degree, 10+ years ML engineering/MLOps experience, strong Python, cloud ML platforms (AWS/GCP/Azure), Docker/Kubernetes, CI/CD, ML frameworks (PyTorch/TensorFlow/JAX), experience with MLflow/W&B and HPC schedulers.
PyTorch, TensorFlow, JAX, Hugging Face, scikit-learn, XGBoost, MLflow, Kubeflow, Airflow, Weights & Biases, DVC, Feast, AWS SageMaker, GCP Vertex AI, Azure ML, Terraform, CloudFormation, Docker, Kubernetes, Slurm, LSF, Python, Bash, Go, SQL, Prometheus, Grafana, ELK Stack, Evidently AI, Arize
4w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York or San Francisco or McLean or Cambridge or San Jose or Plano
$209k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE +6 years or Master's +4 years; 6+ years programming with Python/Go/Scala/Java; experience deploying scalable AI on cloud; LLM, inference, similarity search, VectorDBs, guardrails, model evaluation, and optimization experience; leadership and research literacy.
Python, Go, Scala, Java, C++, C#, Golang, AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure
1mo
Save
Mark Applied
Hide
Principal Engineer, Cloud Data Infrastructure
San Jose or Austin
$218k-$324k/yr HybridFull Time
10+ YOE10+ years relevant experience and a Bachelor’s degree (or equivalent); deep expertise in databases, data pipelines, messaging, caching, performance and resilience engineering; experience with real-time analytics and AI/ML infrastructure; strong technical leadership and mentoring.
2mo
Save
Mark Applied
Hide
Senior AI Engineer
San Jose or California
$187k-$215k/yr HybridFull Time
4+ YOE4+ years software engineering and infrastructure experience, production LLM/agent experience, Python and TypeScript proficiency, Docker/Kubernetes, cloud/distributed systems, ability to work hybrid in San Jose and authorized to work in the U.S.
Agno, LangChain, LlamaIndex, Semantic Kernel, Claude Code, Cursor, AugmentCode, Python, TypeScript, Docker, Kubernetes, CI/CD, LLMs, RAG
3w
Save
Mark Applied
Hide
Sr. Staff AI Engineer - On-Prem AI Infrastructure & Agentic Systems
San Jose, California, United States
$140k-$165k/yr OnsiteFull Time
2+ YOE2+ years in AI/ML engineering with on-prem/private-cloud deployment, experience building agentic AI and RAG pipelines, model fine-tuning (LoRA/QLoRA), Python/Linux/Docker/Kubernetes proficiency, and familiarity with vector DBs and AI serving frameworks.
vLLM, TGI, Triton, Milvus, Qdrant, FAISS, Kubernetes, Helm, Docker, LangGraph, AutoGen, LoRA, QLoRA, Model Control Protocols (MCP), Python, Linux, Pinecone, Ollama, ONNX, TensorRT, GGUF, BabyAGI, LangSmith, Weights & Biases, Prometheus, Grafana, CI/CD
1w
Save
Mark Applied
Hide
AI Infra Engineer - Large Model Training Infrastructure (LLM/VLM /Agent RL)
San Jose, California, United States
$156k-$388k/yr OnsiteFull Time
2+ YOEBachelor's degree, 2+ years in large-scale ML systems or training infrastructure, strong Python and C++ skills, experience with PyTorch and distributed training frameworks (DeepSpeed, Megatron, FSDP), and expertise in large-model training and optimization.
Python, C++, PyTorch, DeepSpeed, Megatron, FSDP
1mo
Save
Mark Applied
Hide
Senior AI Systems Engineer
San Jose, California, United States
$160k-$180k/yr OnsiteFull Time
3+ YOEBS/MS/PhD in CS or related, 3+ years building AI/ML systems or HPC/ML infrastructure, experience with multi-cloud (AWS), Docker, Kubernetes, MLflow, vLLM/SGLang, SkyPilot, SQL/NoSQL and Parquet.
MLflow, Nebius AI Cloud, Docker, Kubernetes, SkyPilot, vLLM, SGLang, SQL, NoSQL, Parquet, AWS
1w
Save
Mark Applied
Hide
Tech Lead Software Engineer - AI Compute Infrastructure
San Jose, California, United States
OnsiteFull Time
5+ YOE5+ years experience building cloud/ML infrastructure, strong knowledge of large-model inference, distributed systems, scheduling, and container orchestration; proficiency in Go/Rust/Python/C++.
vLLM, SGLang, TensorRT-LLM, Kubernetes, Ray, Docker, CUDA, AWS, Azure, GCP, SageMaker, Azure ML, Vertex AI, DeepSpeed, PyTorch, Go, Rust, Python, C++
3w
Save
Mark Applied
Hide
Staff Software Engineer, AI/ML Storage Infrastructure
San Jose, California, United States
$207k-$301k/yr OnsiteFull Time
8+ YOEBachelor's degree or equivalent experience; 8 years C++ programming; 5 years testing/launching software; 5 years building large-scale infrastructure or storage/compute; 3 years software design/architecture.
C++
2mo
Save
Mark Applied
Hide
Kubernetes Platform Engineer – AI Infrastructure
San Jose, California, United States
$153k-$219k/yr HybridFull Time
5+ YOE5+ years software engineering; 3+ years Kubernetes production; etcd; Go; Kubernetes internals; on-call support.
Go, Kubernetes, etcd, OpenShift, Anthos, Python
2w
Save
Mark Applied
Hide
Sr. Director of AI & Infrastructure Sales
San Jose, California, United States
$200k-$330k/yr HybridFull Time
12+ YOE12+ years sales leadership in semiconductors/embedded/data center, proven global revenue growth, experience with OEMs and hyperscalers, Bachelor's in Engineering/Computer Science required; MBA or advanced technical degree preferred.
2mo
Save
Mark Applied
Hide
Machine Learning Engineer, Express AI Foundations
San Jose, California, United States
$126k-$234k/yr OnsiteFull Time
3+ YOE3+ years in software engineering, backend infrastructure, data systems, ML infrastructure; distributed systems; APIs/data pipelines; Python/Java/C/C++/Go; cloud; ML systems familiarity.
Python, Java, C++, Go, Kafka, Spark, Flink, distributed data frameworks
1mo
Save
Mark Applied
Hide
Director, Strategic Accounts - AI/ML Infrastructure
Maple Grove or San Jose
$120k-$200k/yr RemoteFull Time
10+ YOE10+ years in strategic account management or business development for AI/ML infrastructure; engineering degree; executive-level engagement experience.
Salesforce, CRM
1mo
Save
Mark Applied
Hide
IT Support Engineer (AI Infra & Data Center)
San Jose, California, United States
$75k-$95k/yr OnsiteFull Time
Support construction, infrastructure, and IT operations within a large AI data center program; coordinate stakeholders and maintain project artifacts.
Microsoft Office, Project management tools
2w
Save
Mark Applied
Hide
Senior Principal Software Engineer
San Jose, California, United States
$155k-$243k/yr OnsiteFull Time
15+ YOELead design and scaling of test infrastructure, CI/CD, and AI/LLM-driven developer tools; 15+ years engineering experience; Master’s in CS/CE or equivalent; proficiency in Python, Bash, CI/CD, Docker, Jenkins, and networking domains.
Python, Bash, Perl, TCL, Windsurf, Claude Code, Ollama, LlamaIndex, Docker, Jenkins, Ansible, Zabbix, GitLab, GitHub, SONiC, Linux, iperf3, IXIA, Jira, Jira Align
3d
Save
Mark Applied
Hide
Senior Staff Technical Delivery Manager - Platform, AI, and Infrastructure
San Jose or Draper
$187k-$233k/yr RemoteFull Time
6+ YOE6+ years in technical program management or software engineering; strong SDLC and systems-level technical acumen; exceptional communication, influencing, and program execution skills; US work authorization required (no visa sponsorship).
AI tooling, program management platforms, OKR
1w
Save
Mark Applied
Hide
Staff/Principal Forward Deployed Engineer
San Jose, California, United States
$255k-$351k/yr OnsiteFull Time
8+ YOEProven experience architecting and shipping large-scale AI/LLM infrastructure; deep expertise in distributed LLM training/inference, systems design, and cross-functional technical leadership.
Llama, Hugging Face, PyTorch, Ray, vLLM, Triton Inference Server, Kubernetes, DeepSpeed, Megatron-LM, C++, Python, Java, JavaScript
Explore Jobs