PromotedHiringCafe
ML Engineer - Inference & Model Deployment
Cupertino, CA, US
$250k-$310k/yr On-SiteFull Time
Turn powerful AI and ML models into fast, reliable production systems. Own inference latency, throughput, model-serving architecture, multi-GPU systems, and production deployment for millions of users.
Python, PyTorch, vLLM, SGLang, TensorRT, LLMs
PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
PromotedHiringCafe
Founding Backend / Infra Engineer
Cupertino, CA, US
$160k-$300k/yr On-SiteFull Time
Own the crawlers, pipelines, and infrastructure powering a real-time job search engine. Strong Node.js and Python fundamentals; bonus points for security and reverse-engineering chops.
Node.js, Python, Elasticsearch, Redis
3w
Save
Mark Applied
Hide
Staff ML Infrastructure Engineer
Sunnyvale, California, United States
$189k-$291k/yr HybridFull Time
5+ YOE5+ years building large-scale distributed or ML systems; strong APIs and cloud infrastructure experience; expertise in ML lifecycle and MLOps; coding in Python or C++; BS/MS/PhD in CS/Math or equivalent experience.
Python, C++, PyTorch, TensorFlow, Bazel, Buck, Blaze, CMake, Docker, Kubernetes
2mo
Save
Mark Applied
Hide
ML Infrastructure Engineer
San Francisco, California, United States
$160k-$200k/yr OnsiteFull Time
3+ YOE3+ years in ML infrastructure; BS/MS in CS/Engineering; strong Python and PyTorch; data versioning, pipelines, and model serving experience; good communication.
Python, PyTorch, Airflow, Prefect, Metaflow, DVC, Weights & Biases, TensorRT, ONNX Runtime, Terraform, AWS
3mo
Save
Mark Applied
Hide
ML Ops Infrastructure Engineer
United States
$160k-$220k/yr RemoteFull Time
4+ YOE4+ years in MLOps/DevOps or infrastructure with ML systems; Python; CI/CD; Docker; Kubernetes; production ML; monitoring/observability.
Python, Docker, Kubernetes, CI/CD, Monitoring, Terraform
1mo
Save
Mark Applied
Hide
Founding ML infrastructure Engineer
San Francisco or United States
$200k-$350k/yr RemoteFull Time
Experience designing and operating large-scale distributed infrastructure; Kubernetes/Slurm; multi-cloud GPU; reliability and scheduling; startup mindset.
Kubernetes, Slurm, Scheduling, TensorRT-LLM, NCCL, InfiniBand, RoCE, CuTe, Triton, TileLang
1mo
Save
Mark Applied
Hide
HPC/ML Infrastructure Engineer
San Francisco or Tokyo
OnsiteFull Time
Experienced HPC/ML infrastructure engineer with Linux sysadmin skills, cluster bring-up and operations experience, familiarity with SLURM and parallel filesystems, networking and datacenter hardware handling.
SLURM, Slinky, K8s, Warewulf, MAAS, Ansible, WEKA, VAST, Ceph, Tailscale, Grafana, Prometheus, LDAP, dmesg, HGX, VLAN
3mo
Save
Mark Applied
Hide
ML Infrastructure/Platform Engineer
New York City, New York, United States
$140k-$200k/yr HybridFull Time
3+ YOE3+ years in data engineering or ML infrastructure; Python and SQL; orchestration tools (Prefect/Airflow/Dagster); Docker/Kubernetes; cloud (Azure preferred); model serving; monitoring; strong documentation.
Python, SQL, Prefect, Airflow, Dagster, Docker, Kubernetes, Azure, MLflow, LangChain, Snowflake, dbt
3mo
Save
Mark Applied
Hide
Senior ML Infrastructure Engineer, Proactive
Cupertino or Seattle
OnsiteFull Time
Experience designing large-scale ML/AI platforms; proficiency in ML systems, LLMs, and distributed data; strong multi-threaded programming skills.
Python, Distributed systems, MacOS/iOS development, LLMs, Machine learning platforms
1mo
Save
Mark Applied
Hide
Sr. ML Infrastructure Engineer II, Personalization
San Mateo, California, United States
$170k-$220k/yr HybridFull Time
8+ YOE8+ years in ML; end-to-end recommender systems; deep learning for recsys; PyTorch/TensorFlow; vector databases; cloud infra; strong modeling and infra skills.
PyTorch, TensorFlow, Vector databases, Elasticsearch, SQS, Kafka, AWS SageMaker, TorchServe, Triton, FAISS, ScaNN, OpenSearch k-NN, Pinecone, Weaviate, Spark, SQL, Linux, Docker, Kubernetes, Ansible, LLMs, REST APIs
3w
Save
Mark Applied
Hide
ML Infrastructure Engineer
California, United States
OnsiteFull Time
Maven Robotics: Developing autonomous general-purpose robots powered by artificial intelligence.
Significant experience building and operating production backend, distributed, or compute infrastructure; strong programming in Python, Go, Rust, or C++; experience with Kubernetes, Ray, ZenML, storage, observability, IaC, and GPU compute orchestration.
Python, Go, Rust, C++, Kubernetes, Ray, ZenML
1mo
Save
Mark Applied
Hide
Software Engineer, ML Infrastructure
Mountain View, California, United States
$160k-$241k/yr OnsiteFull Time
3+ YOE3+ years in ML infrastructure/backend platform or distributed systems. Experience with Terraform/Pulumi/Crossplane, Kubernetes/Ray/Slurm/Volcano schedulers, Apache Spark/Beam, feature stores (Feast/Hopsworks/Redis), and systems design for HPC.
Terraform, Pulumi, Crossplane, Kubernetes, KubeRay, Ray, Slurm, Volcano, Apache Spark, Apache Beam, Feast, Hopsworks, Redis, Lustre, Ceph, NVMe, AWS, GCP, Azure, Kubeflow, CNCF
1mo
Save
Mark Applied
Hide
Senior ML Infrastructure Engineer
New York City, New York, United States
OnsiteFull Time
3+ YOEBachelor's degree or higher in CS/EE or related field; 3+ years backend infra; expert Python; 2+ years cloud (AWS); design APIs/SDKs; ML workflows.
Python, AWS, IAM, Networking, Cost Management, APIs, SDKs
1mo
Save
Mark Applied
Hide
ML & Cloud Infrastructure Engineer
Belmont, California, United States
OnsiteFull Time
4+ YOE4+ years deploying high-performance ML pipelines; proficient in Python; comfortable with C++/Go; PyTorch; cloud platforms (AWS, GCP, Azure); Docker/Kubernetes/Airflow; Parquet/HDF5/TFRecord; US work authorization.
Python, C++, Go, PyTorch, Parquet, HDF5, TFRecord, AWS, GCP, Azure, Docker, Kubernetes, Airflow
3w
Save
Mark Applied
Hide
Senior ML Infrastructure Engineer
Edison, New Jersey, United States
OnsiteFull Time
Experience with Azure Kubernetes Service (AKS), GPU cluster configuration, CUDA/cuDNN, PyTorch, Python, Kubernetes autoscaling (KEDA), Azure infra (ADLS, Key Vault, VNet), Docker/Helm, and IaC (Terraform/Bicep).
Azure Kubernetes Service (AKS), Kubernetes, KEDA, Azure Data Lake Storage Gen2, Azure OpenAI, CUDA, cuDNN, PyTorch, Hugging Face Transformers, BERT, Python, Azure SDK, Docker, Helm, Terraform, Bicep, VNet, Azure Key Vault, Active Directory (AD)
1mo
Save
Mark Applied
Hide
Senior ML Infrastructure Engineer
New York City, New York, United States
$180k-$230k/yr OnsiteFull Time
5+ YOEExperience building scalable data pipelines; proficiency in Spark, Databricks, SQL, PySpark, Python; strong communication; ownership of end-to-end data systems; healthcare/insurance domain preferred.
Spark, Databricks, SQL, PySpark, Python, Git
2d
Save
Mark Applied
Hide
Senior ML Infra Engineer
Santa Clara, California, United States
OnsiteFull Time
Experience building production ML training and deployment systems, strong software engineering and infra fundamentals, PyTorch experience, HPC/GPU knowledge, and strong communication and product sense.
Python, PyTorch, Docker, CI/CD, GPUs, CUDA, vLLM, TensorRT, Triton
3mo
Save
Mark Applied
Hide
Staff AI/ML Infrastructure Engineer
United States
$145k-$160k/yr RemoteFull Time
5+ YOE5+ years in bare metal infrastructure, GPU platforms, Linux, and automation with Python/Bash; hardware, BIOS/firmware, and driver experience; leadership experience.
Linux, Python, Bash, NVIDIA GPUs, AMD GPUs, BIOS, BMC, Redfish/IPMI, PCIe, RoCE, InfiniBand
2mo
Save
Mark Applied
Hide
Staff Software Engineer, ML Infrastructure
San Francisco, California, United States
$220k-$260k/yr HybridFull Time
7+ YOE7+ years software systems, ML infra experience, Python, PyTorch, ML tooling, strong communication.
Python, PyTorch, AWS, TensorRT, ONNX, Weights & Biases, MLflow, ClearML
1w
Save
Mark Applied
Hide
Senior / Principal Infrastructure Engineer - ML Platform
San Mateo, California, United States
$279k-$345k/yr HybridFull Time
6+ YOE6+ years experience building scalable infrastructure; deep Kubernetes and Terraform experience; familiarity with AWS/GCP, Docker, CI/CD; bachelor's degree or equivalent practical experience.
Kubernetes, Terraform, AWS, GCP, Docker, CI/CD
1mo
Save
Mark Applied
Hide
ML Engineer
Palo Alto or Seattle or Paris
$139k-$226k/yr RemoteFull Time
5+ YOE5+ years applied ML/AI experience, 4+ years software engineering, experience with LLM-based systems, model lifecycle and ML infrastructure, bachelor's in CS/Engineering or equivalent, strong communication and mentoring skills.
Docker Desktop, Docker Hub, Docker Scout, LLM, MCP, Agentic Platform
4d
Save
Mark Applied
Hide
ML Infrastructure engineer - Early Career
Mountain View or Washington
$143k-$186k/yr OnsiteFull Time
Bachelor's degree in CS or related, strong foundation in ML systems or distributed systems, experience with Python, familiarity with ML frameworks and distributed tools, and ability to build scalable ML infrastructure.
Python, PyTorch, Ray, Airflow, Flyte, TensorFlow, Spark
Explore Jobs