HiringCafe
Join our community

290 ml infrastructure engineer jobs at 73 companies in Tracy, CA

PromotedHiringCafe
ML Engineer - Inference & Model Deployment
Cupertino, CA, US
$250k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Turn powerful AI and ML models into fast, reliable production systems. Own inference latency, throughput, model-serving architecture, multi-GPU systems, and production deployment for millions of users.
Python, PyTorch, vLLM, SGLang, TensorRT, LLMs
Help us #BeatIndeed & #BeatLinkedIn
PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
PromotedHiringCafe
Founding Backend / Infra Engineer
Cupertino, CA, US
$160k-$300k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Own the crawlers, pipelines, and infrastructure powering a real-time job search engine. Strong Node.js and Python fundamentals; bonus points for security and reverse-engineering chops.
Node.js, Python, Elasticsearch, Redis
Help us #BeatIndeed & #BeatLinkedIn
2w
Save
Mark Applied
Hide
Staff ML Infrastructure Engineer
Sunnyvale, California, United States
$189k-$291k/yr HybridFull Time
General Motors
General MotorsNYSE: GM: Manufactures and sells automobiles and automotive parts globally.
5+ YOE5+ years building large-scale distributed or ML systems; strong APIs and cloud infrastructure experience; expertise in ML lifecycle and MLOps; coding in Python or C++; BS/MS/PhD in CS/Math or equivalent experience.
Python, C++, PyTorch, TensorFlow, Bazel, Buck, Blaze, CMake, Docker, Kubernetes
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior ML Infrastructure Engineer, Proactive
Cupertino or Seattle
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
Experience designing large-scale ML/AI platforms; proficiency in ML systems, LLMs, and distributed data; strong multi-threaded programming skills.
Python, Distributed systems, MacOS/iOS development, LLMs, Machine learning platforms
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer, ML Infrastructure
Mountain View, California, United States
$160k-$241k/yr OnsiteFull Time
Nuro
Nuro: Builds autonomous driving software and electric delivery robots.
3+ YOE3+ years in ML infrastructure/backend platform or distributed systems. Experience with Terraform/Pulumi/Crossplane, Kubernetes/Ray/Slurm/Volcano schedulers, Apache Spark/Beam, feature stores (Feast/Hopsworks/Redis), and systems design for HPC.
Terraform, Pulumi, Crossplane, Kubernetes, KubeRay, Ray, Slurm, Volcano, Apache Spark, Apache Beam, Feast, Hopsworks, Redis, Lustre, Ceph, NVMe, AWS, GCP, Azure, Kubeflow, CNCF
Job PostingView all
2d
Save
Mark Applied
Hide
Senior ML Infra Engineer
Santa Clara, California, United States
OnsiteFull Time
MaxInsights
MaxInsights: Provides robot data collection for physical AI development.
Experience building production ML training and deployment systems, strong software engineering and infra fundamentals, PyTorch experience, HPC/GPU knowledge, and strong communication and product sense.
Python, PyTorch, Docker, CI/CD, GPUs, CUDA, vLLM, TensorRT, Triton
Job PostingView all
1mo
Save
Mark Applied
Hide
ML Engineer
Palo Alto or Seattle or Paris
$139k-$226k/yr RemoteFull Time
Docker
Docker: Provides a platform for building, sharing, and running containerized applications.
5+ YOE5+ years applied ML/AI experience, 4+ years software engineering, experience with LLM-based systems, model lifecycle and ML infrastructure, bachelor's in CS/Engineering or equivalent, strong communication and mentoring skills.
Docker Desktop, Docker Hub, Docker Scout, LLM, MCP, Agentic Platform
Job PostingView all
3d
Save
Mark Applied
Hide
ML Infrastructure engineer - Early Career
Mountain View or Washington
$143k-$186k/yr OnsiteFull Time
Unity
UnityNYSE: U: Provides software for creating real-time 3D interactive content.
Bachelor's degree in CS or related, strong foundation in ML systems or distributed systems, experience with Python, familiarity with ML frameworks and distributed tools, and ability to build scalable ML infrastructure.
Python, PyTorch, Ray, Airflow, Flyte, TensorFlow, Spark
Job PostingView all
2mo
Save
Mark Applied
Hide
Autonomy Engineer - ML & DL Infrastructure
San Mateo, California, United States
$170k-$278k/yr HybridFull Time
Skydio
Skydio: Develops autonomous AI drones for defense and industrial inspection.
Experience with data engineering, cloud ML platforms, ML Ops, large-scale data pipelines, model training/deployment, and security/compliance in ML infrastructure; strong collaboration.
Cloud platforms, Containerization, ML Ops, Databases, Data pipelines
Job PostingView all
1mo
Save
Mark Applied
Hide
AI Infrastructure Engineer
San Jose, California, United States
$179k-$306k/yr HybridFull Time
AMD
AMDNASDAQ: AMD: Designs and manufactures computer processors and graphics technology.
5+ YOE5+ years in DevOps/platform/infrastructure engineering; deep Kubernetes experience; experience building developer-facing platforms, Helm and GitOps workflows, storage/networking for GPU workloads; Terraform, monitoring, and ML framework exposure preferred.
Kubernetes, Helm, ArgoCD, Flux, GitOps, Terraform, CSI drivers, CNI, Prometheus, Grafana, Loki, Slurm, PyTorch, vLLM, SGLang
Job PostingView all
1w
Save
Mark Applied
Hide
Sr. Mgr., ML Infrastructure, PV Personalization and Discovery
Sunnyvale or Seattle or New York
$242k-$328k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
10+ YOE5+ Mgmt10+ years engineering experience, 5+ years managing engineering teams, expertise in ML infrastructure, retrieval/recommendation systems, LLMs/generative AI, partnering with applied scientists, experience delivering large-scale consumer software.
AWS
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Infrastructure Engineer – Bazel Remote Execution
Santa Clara, California, United States
$184k-$357k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
8+ YOE8+ years building scalable cloud infrastructure from concept to production; background in AI/ML or data analytics; strong OOP skills in Java or Go/Golang; experience with Kubernetes and distributed systems; Bachelor's or equivalent.
Bazel Remote Execution, Buildbarn, Buildfarm, Kubernetes, Java, Go, Golang
Job PostingView all
2mo
Save
Mark Applied
Hide
Inference Infrastructure Engineer
Palo Alto, California, United States
OnsiteFull Time
Rhoda AI
Rhoda AI: Developing generalist robotic intelligence for real-world industrial automation.
3+ YOE3+ years in ML infrastructure, MLOps, or distributed systems; strong Kubernetes; GPU orchestration; cloud/hybrid infra; ML frameworks; debugging ownership.
Kubernetes, Triton, Ray Serve, TorchServe, PyTorch, JAX, AWS, GCP, Kafka, gRPC, NATS, SLURM, Ray, Volcano
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Machine Learning Infrastructure Engineer, Simulation
Mountain View or San Francisco
$213k-$263k/yr OnsiteFull Time
Waymo
Waymo: Autonomous driving technology for ride-hailing and logistics.
5+ YOE5+ years of professional software engineering, with 3+ years in ML infrastructure; BS in CS/Robotics or related field.
DeepSpeed, PyTorch, TensorFlow, ML infrastructure
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Engineer, Cloud Data Infrastructure
San Jose or Austin
$218k-$324k/yr HybridFull Time
PayPal
PayPalNASDAQ: PYPL: Digital platform for sending money and processing online payments.
10+ YOE10+ years relevant experience and a Bachelor’s degree (or equivalent); deep expertise in databases, data pipelines, messaging, caching, performance and resilience engineering; experience with real-time analytics and AI/ML infrastructure; strong technical leadership and mentoring.
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff AI/ML Software Engineer, YouTube Ads Creative Foundational Infrastructure
Mountain View, California, United States
$207k-$301k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
8+ YOEBachelor's in CS or equivalent, 8+ years software development, 5+ years building large-scale infrastructure, 3+ years software design, experience with ML infrastructure; leadership and deep learning framework experience preferred.
TensorFlow, PyTorch
Job PostingView all
4w
Save
Mark Applied
Hide
Software Engineer, Systems ML
Bellevue or Menlo Park or New York
$184k-$257k/yr OnsiteFull Time
Meta
MetaNASDAQ: META: Develops social networking platforms and virtual reality technologies.
8+ YOEBachelor's or equivalent, 8+ years in systems engineering/ML infrastructure, experience with distributed ML training/inference, PyTorch/JAX/TensorFlow, low-level C++/CUDA optimizations, and leading cross-functional ML systems projects.
PyTorch, JAX, TensorFlow, C++, CUDA, MLIR, XLA, TVM, Triton
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. ML Ops Engineer
Mountain View or United States
HybridFull Time
Corvus Robotics
Corvus Robotics: Fully autonomous drones for automated warehouse inventory management.
2+ YOE2-3 years building production ML infrastructure; experience with distributed data pipelines; understanding data flow from raw to trained models; ability to build from scratch or contribute to infra; thrive in ambiguous startup environment.
Kubeflow, SLURM, S3, data pipelines, distributed training
Job PostingView all
1mo
Save
Mark Applied
Hide
Distinguished Engineer - Wireless Infrastructure
Santa Clara or New Hampshire or Massachusetts
$320k-$489k/yr HybridFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
20+ YOEMS/PhD in CS/EE or equivalent experience, 20+ years industry experience, deep expertise in communication systems, RAN algorithms, AI/ML for RAN, and programming in Python, C/C++, Matlab.
Python, C/C++, Matlab
Job PostingView all
3w
Save
Mark Applied
Hide
Staff ML Infra Engineer, Search & Discovery
Mountain View, California, United States
$174k-$299k/yr OnsiteFull Time
Coupang
CoupangNYSE: CPNG: Provides online retail, grocery delivery, and video streaming services.
5+ YOEBachelor's in CS/EE/math/stats, 5+ years applied ML experience, production ML systems experience, proficiency in Python/Java, experience with big data, ML frameworks, and cloud platforms.
Python, Java, Hadoop, Hive, Presto, Spark, Scala, Apache Airflow, TensorFlow, PyTorch, AWS, GCP
Job PostingView all
1w
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer - Model Training
Mountain View, California, United States
$190k-$260k/yr OnsiteFull Time
Kodiak Robotics
Kodiak RoboticsNASDAQ: KDK: Develops autonomous driving technology for commercial trucking and defense.
2+ YOEDegree in CS or related field,2+ years ML systems experience,expertise in distributed training,high-performance data pipelines,GPU performance and profiling,Python and PyTorch skills.
PyTorch, PyTorch DDP/FSDP, DeepSpeed, Megatron, NCCL, WebDataset, MosaicML Streaming, MDS, Nsight, PyTorch Profiler, Python, C++, CUDA, Triton, NVLink, InfiniBand
Job PostingView all
1w
Save
Mark Applied
Hide
Software Engineer, Ads ML Infrastructure
San Jose, California, United States
$156k-$317k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
3+ YOE3+ years building scalable ML systems, strong CS fundamentals, coding skills, experience with causal inference/uplift/deep learning, project management and communication skills.
Job PostingView all

Explore Jobs

Expand Your Job Search