29 ai ml infrastructure engineer jobs at 16 companies in Gustine, CA
1mo
Save
Mark Applied
Hide
Senior MLOps & AI Infrastructure Engineer
San Jose, California, United States
$149k-$216k/yr OnsiteFull Time
10+ YOEBachelor's degree, 10+ years ML engineering/MLOps experience, strong Python, cloud ML platforms (AWS/GCP/Azure), Docker/Kubernetes, CI/CD, ML frameworks (PyTorch/TensorFlow/JAX), experience with MLflow/W&B and HPC schedulers.
PyTorch, TensorFlow, JAX, Hugging Face, scikit-learn, XGBoost, MLflow, Kubeflow, Airflow, Weights & Biases, DVC, Feast, AWS SageMaker, GCP Vertex AI, Azure ML, Terraform, CloudFormation, Docker, Kubernetes, Slurm, LSF, Python, Bash, Go, SQL, Prometheus, Grafana, ELK Stack, Evidently AI, Arize
1mo
Save
Mark Applied
Hide
Staff Software Engineer, AI/ML Storage Infrastructure
San Jose, California, United States
$207k-$301k/yr OnsiteFull Time
8+ YOEBachelor's degree or equivalent experience; 8 years C++ programming; 5 years testing/launching software; 5 years building large-scale infrastructure or storage/compute; 3 years software design/architecture.
C++
2mo
Save
Mark Applied
Hide
Helix AI Engineer, Backend Infrastructure
San Jose, California, United States
$150k-$400k/yr OnsiteFull Time
5+ YOESenior backend engineer skilled in high-throughput, real-time streaming, cloud systems, and ML-serving integration.
Go, C++, Python, Rust, AWS, GCP, Azure, Docker, Kubernetes, Service Mesh, CI/CD
1mo
Save
Mark Applied
Hide
Principal Engineer, Cloud Data Infrastructure
San Jose or Austin
$218k-$324k/yr HybridFull Time
10+ YOE10+ years relevant experience and a Bachelor’s degree (or equivalent); deep expertise in databases, data pipelines, messaging, caching, performance and resilience engineering; experience with real-time analytics and AI/ML infrastructure; strong technical leadership and mentoring.
4w
Save
Mark Applied
Hide
Software Engineer Graduate (Data Arch - AI/ML Infrastructure) - 2026 Start (PhD)
San Jose, California, United States
$156k-$317k/yr OnsiteFull Time
PhD (by 2026) in CS/ML/AI, research in ML/AI with focus on inference/model acceleration, programming experience in C/C++/Java/Python, strong problem-solving and communication skills.
C, C++, Java, Python
1mo
Save
Mark Applied
Hide
Sr. Staff AI Engineer - On-Prem AI Infrastructure & Agentic Systems
San Jose, California, United States
$140k-$165k/yr OnsiteFull Time
2+ YOE2+ years in AI/ML engineering with on-prem/private-cloud deployment, experience building agentic AI and RAG pipelines, model fine-tuning (LoRA/QLoRA), Python/Linux/Docker/Kubernetes proficiency, and familiarity with vector DBs and AI serving frameworks.
vLLM, TGI, Triton, Milvus, Qdrant, FAISS, Kubernetes, Helm, Docker, LangGraph, AutoGen, LoRA, QLoRA, Model Control Protocols (MCP), Python, Linux, Pinecone, Ollama, ONNX, TensorRT, GGUF, BabyAGI, LangSmith, Weights & Biases, Prometheus, Grafana, CI/CD
1mo
Save
Mark Applied
Hide
Senior AI Systems Engineer
San Jose, California, United States
$160k-$180k/yr OnsiteFull Time
3+ YOEBS/MS/PhD in CS or related, 3+ years building AI/ML systems or HPC/ML infrastructure, experience with multi-cloud (AWS), Docker, Kubernetes, MLflow, vLLM/SGLang, SkyPilot, SQL/NoSQL and Parquet.
MLflow, Nebius AI Cloud, Docker, Kubernetes, SkyPilot, vLLM, SGLang, SQL, NoSQL, Parquet, AWS
2mo
Save
Mark Applied
Hide
Director, Strategic Accounts - AI/ML Infrastructure
Maple Grove or San Jose
$120k-$200k/yr RemoteFull Time
10+ YOE10+ years in strategic account management or business development for AI/ML infrastructure; engineering degree; executive-level engagement experience.
Salesforce, CRM
3w
Save
Mark Applied
Hide
Tech Lead Software Engineer - AI Compute Infrastructure
San Jose, California, United States
OnsiteFull Time
5+ YOE5+ years experience building cloud/ML infrastructure, strong knowledge of large-model inference, distributed systems, scheduling, and container orchestration; proficiency in Go/Rust/Python/C++.
vLLM, SGLang, TensorRT-LLM, Kubernetes, Ray, Docker, CUDA, AWS, Azure, GCP, SageMaker, Azure ML, Vertex AI, DeepSpeed, PyTorch, Go, Rust, Python, C++
3mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Cambridge or Richmond or McLean or New York or San Jose or San Francisco
$286k-$392k/yr RemoteFull Time
10+ YOE10+ years AI/ML engineering; Python/Go/Scala/Java; distributed compute; CPU/GPU infrastructure; ML/AI workloads.
Python, Go, Scala, Java, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda
2mo
Save
Mark Applied
Hide
AI Engineer, TikTok Risk & Integrity - USDS
San Jose, California, United States
$137k-$360k/yr OnsiteFull Time
Bachelor's in CS/math/stat or related, strong ML and MLOps experience, proficiency with transformers and GNNs, coding in Python/C++/Go, distributed computing and PyTorch experience, experience building large-scale AI infrastructure.
MLOps, Transformer, GNN, Python, C++, Go, Spark, Flink, PyTorch, LLM
3mo
Save
Mark Applied
Hide
Machine Learning Engineer, Express AI Foundations
San Jose, California, United States
$126k-$234k/yr OnsiteFull Time
3+ YOE3+ years in software engineering, backend infrastructure, data systems, ML infrastructure; distributed systems; APIs/data pipelines; Python/Java/C/C++/Go; cloud; ML systems familiarity.
Python, Java, C++, Go, Kafka, Spark, Flink, distributed data frameworks
1w
Save
Mark Applied
Hide
Senior Director of Engineering - Next-generation Network OS for Switching and routing Infrastructure-10393
San Jose, California, United States
$250k-$310k/yr HybridFull Time
20+ YOE7+ Mgmt20+ years engineering experience with leadership of large global teams; deep networking infrastructure expertise; hands-on adoption of AI/ML tools; cloud-native, microservices, DevSecOps and CI/CD experience.
CI/CD, DevSecOps, AI/ML, observability, telemetry, machine learning, artificial intelligence
6d
Save
Mark Applied
Hide
Sr. GenAI/ML Specialist Solutions Architect, AGS Specialist Solutions Architects
San Francisco or Atlanta or New York City or Denver or San Jose or Los Angeles or Seattle or Chicago or Austin or Dallas or Arlington
$154k-$239k/yr OnsiteFull Time
8+ YOE8+ years technical experience, 3+ years designing and consulting on applications/infrastructure, experience in sales-facing technical roles, deep AI/ML knowledge, strong math/stat and communication skills.
Apache MxNet, TensorFlow, Amazon SageMaker, Amazon Bedrock, Amazon AgentCore, Amazon Rekognition, Amazon Transcribe, Amazon Comprehend, Amazon Kendra, Amazon Personalize, Amazon Quick
3d
Save
Mark Applied
Hide
Senior Solution Engineer
San Francisco or San Jose or Bellevue
$226k-$355k/yr HybridFull Time
8+ YOE8+ years designing and deploying enterprise cloud infrastructure, 4+ years in solution engineering roles, 3+ years deploying AI/ML workloads; experience with NVIDIA GPU architectures, Kubernetes, SLURM, and coding in Python/Go/C/C++.
NVIDIA, HGX, NVLink, PyTorch, NeMo, vLLM, TensorRT-LLM, SLURM, Kubernetes, Docker, Terraform, Ansible, InfiniBand, RoCE, NFS, NVMe-oF, Weka, VAST, Python, Go, C/C++, CUDA, RESTful APIs, gRPC
1mo
Save
Mark Applied
Hide
Director of Product Management – AI Essentials
Spring or San Jose or Durham or Fort Collins or Andover
$170k-$413k/yr HybridFull Time
15+ YOE5+ MgmtBachelor's in CS/engineering required; 15+ years product experience with 5+ years leading product teams in AI/ML or data infrastructure. Experience with AI platforms, model serving, GPU ecosystems, GTM and monetization.
GenAI, GPU, MLOps, GreenLake, AI tools, AI/ML, SaaS, DevOps, agent frameworks