56 ml infrastructure engineer jobs at 19 companies in Newman, CA
1mo
Save
Mark Applied
Hide
Principal Engineer, Cloud Data Infrastructure
San Jose or Austin
$218k-$324k/yr HybridFull Time
10+ YOE10+ years relevant experience and a Bachelor’s degree (or equivalent); deep expertise in databases, data pipelines, messaging, caching, performance and resilience engineering; experience with real-time analytics and AI/ML infrastructure; strong technical leadership and mentoring.
1mo
Save
Mark Applied
Hide
Staff Software Engineer, AI/ML Storage Infrastructure
San Jose, California, United States
$207k-$301k/yr OnsiteFull Time
8+ YOEBachelor's degree or equivalent experience; 8 years C++ programming; 5 years testing/launching software; 5 years building large-scale infrastructure or storage/compute; 3 years software design/architecture.
C++
4w
Save
Mark Applied
Hide
Software Engineer, Ads ML Infrastructure
San Jose, California, United States
$156k-$317k/yr OnsiteFull Time
3+ YOE3+ years building scalable ML systems, strong CS fundamentals, coding skills, experience with causal inference/uplift/deep learning, project management and communication skills.
2mo
Save
Mark Applied
Hide
Helix AI Engineer, Backend Infrastructure
San Jose, California, United States
$150k-$400k/yr OnsiteFull Time
5+ YOESenior backend engineer skilled in high-throughput, real-time streaming, cloud systems, and ML-serving integration.
Go, C++, Python, Rust, AWS, GCP, Azure, Docker, Kubernetes, Service Mesh, CI/CD
1mo
Save
Mark Applied
Hide
Senior MLOps & AI Infrastructure Engineer
San Jose, California, United States
$149k-$216k/yr OnsiteFull Time
10+ YOEBachelor's degree, 10+ years ML engineering/MLOps experience, strong Python, cloud ML platforms (AWS/GCP/Azure), Docker/Kubernetes, CI/CD, ML frameworks (PyTorch/TensorFlow/JAX), experience with MLflow/W&B and HPC schedulers.
PyTorch, TensorFlow, JAX, Hugging Face, scikit-learn, XGBoost, MLflow, Kubeflow, Airflow, Weights & Biases, DVC, Feast, AWS SageMaker, GCP Vertex AI, Azure ML, Terraform, CloudFormation, Docker, Kubernetes, Slurm, LSF, Python, Bash, Go, SQL, Prometheus, Grafana, ELK Stack, Evidently AI, Arize
1mo
Save
Mark Applied
Hide
Tech Lead, Machine Learning Infrastructure Engineer - USDS
San Jose, California, United States
$187k-$438k/yr OnsiteFull Time
5+ YOEBachelor's/Master's in CS or related,5+ years software engineering,3+ years ML infrastructure,expertise in Python/C++/Java,PyTorch/Tensorflow,Kubernetes,Slurm,CUDA and GPU cluster management.
Python, C++, Java, PyTorch, Tensorflow, Kubernetes, Slurm, CUDA, InfiniBand, RoCE, Megatron, DeepSpeed, Triton, Cutlass, TensorRT, Triton Inference Server
3mo
Save
Mark Applied
Hide
Sr Staff Engineer, Data Infrastructure
San Jose, California, United States
$182k-$228k/yr OnsiteFull Time
Build and scale data infrastructure for data engineering/ML; Kubernetes, Trino, Ray, MLflow; on-call; Go or Python; BS in CS/Engineering or equivalent.
Kubernetes, Trino, Ray, JupyterHub, MLflow, Vector, VictoriaMetrics, ArgoCD, Terraform
4w
Save
Mark Applied
Hide
Tech Lead Software Engineer - AI Compute Infrastructure
San Jose, California, United States
OnsiteFull Time
5+ YOE5+ years experience building cloud/ML infrastructure, strong knowledge of large-model inference, distributed systems, scheduling, and container orchestration; proficiency in Go/Rust/Python/C++.
vLLM, SGLang, TensorRT-LLM, Kubernetes, Ray, Docker, CUDA, AWS, Azure, GCP, SageMaker, Azure ML, Vertex AI, DeepSpeed, PyTorch, Go, Rust, Python, C++
1mo
Save
Mark Applied
Hide
Software Engineer, ML Engineering
San Jose or Hong Kong
RemoteFull Time
3+ YOE3+ years building production ML systems or training infrastructure; proficiency in Python and one systems language (C++, C#, Java, Rust, or Go); experience with PyTorch or TensorFlow; building training pipelines, data workflows, and model deployment.
Python, C++, C#, Java, Rust, Go, PyTorch, TensorFlow, Docker
2mo
Save
Mark Applied
Hide
Director, Strategic Accounts - AI/ML Infrastructure
Maple Grove or San Jose
$120k-$200k/yr RemoteFull Time
10+ YOE10+ years in strategic account management or business development for AI/ML infrastructure; engineering degree; executive-level engagement experience.
Salesforce, CRM
3mo
Save
Mark Applied
Hide
Machine Learning Engineer, Express AI Foundations
San Jose, California, United States
$126k-$234k/yr OnsiteFull Time
3+ YOE3+ years in software engineering, backend infrastructure, data systems, ML infrastructure; distributed systems; APIs/data pipelines; Python/Java/C/C++/Go; cloud; ML systems familiarity.
Python, Java, C++, Go, Kafka, Spark, Flink, distributed data frameworks
3mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Cambridge or Richmond or McLean or New York or San Jose or San Francisco
$286k-$392k/yr RemoteFull Time
10+ YOE10+ years AI/ML engineering; Python/Go/Scala/Java; distributed compute; CPU/GPU infrastructure; ML/AI workloads.
Python, Go, Scala, Java, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda
3w
Save
Mark Applied
Hide
AI Platform Engineer
Milpitas, California, United States
$136k-$232k/yr OnsiteFull Time
5+ YOEDegree in CS/CE or related, 5+ years systems/DevOps/ML infrastructure experience, hands-on AI/GPU cluster and Linux/Kubernetes expertise, Python/Bash scripting, and knowledge of storage, networking, and security.
Linux, Kubernetes, Docker, Slurm, Ray, TensorFlow, PyTorch, GPU, TPU, Bash, Python, CI/CD, Infrastructure as Code (IaC), TPM
1mo
Save
Mark Applied
Hide
Sr. Staff AI Engineer - On-Prem AI Infrastructure & Agentic Systems
San Jose, California, United States
$140k-$165k/yr OnsiteFull Time
2+ YOE2+ years in AI/ML engineering with on-prem/private-cloud deployment, experience building agentic AI and RAG pipelines, model fine-tuning (LoRA/QLoRA), Python/Linux/Docker/Kubernetes proficiency, and familiarity with vector DBs and AI serving frameworks.
vLLM, TGI, Triton, Milvus, Qdrant, FAISS, Kubernetes, Helm, Docker, LangGraph, AutoGen, LoRA, QLoRA, Model Control Protocols (MCP), Python, Linux, Pinecone, Ollama, ONNX, TensorRT, GGUF, BabyAGI, LangSmith, Weights & Biases, Prometheus, Grafana, CI/CD
2d
Save
Mark Applied
Hide
Sr Software Engineer
San Jose, California, United States
$188k-$271k/yr HybridFull Time
5+ YOEBachelor's degree in computer science, computer engineering, electrical engineering, or related field, plus 5 years' experience. Requires Java, Python, Golang, GCP, Kubernetes, MLOps, and production ML infrastructure expertise.
Java, Python, Golang, GCP, Kubernetes, Prometheus, Datadog, Jupyter Notebook, Spark, MLFlow, ONNX, MySQL, MLOps, ML Model Serving, CRDs/controllers
1w
Save
Mark Applied
Hide
Senior Director of Engineering - Next-generation Network OS for Switching and routing Infrastructure-10393
San Jose, California, United States
$250k-$310k/yr HybridFull Time
20+ YOE7+ Mgmt20+ years engineering experience with leadership of large global teams; deep networking infrastructure expertise; hands-on adoption of AI/ML tools; cloud-native, microservices, DevSecOps and CI/CD experience.
CI/CD, DevSecOps, AI/ML, observability, telemetry, machine learning, artificial intelligence
1w
Save
Mark Applied
Hide
Sr. GenAI/ML Specialist Solutions Architect, AGS Specialist Solutions Architects
San Francisco or Atlanta or New York City or Denver or San Jose or Los Angeles or Seattle or Chicago or Austin or Dallas or Arlington
$154k-$239k/yr OnsiteFull Time
8+ YOE8+ years technical experience, 3+ years designing and consulting on applications/infrastructure, experience in sales-facing technical roles, deep AI/ML knowledge, strong math/stat and communication skills.
Apache MxNet, TensorFlow, Amazon SageMaker, Amazon Bedrock, Amazon AgentCore, Amazon Rekognition, Amazon Transcribe, Amazon Comprehend, Amazon Kendra, Amazon Personalize, Amazon Quick
3d
Save
Mark Applied
Hide
Senior Solution Engineer
San Francisco or San Jose or Bellevue
$226k-$355k/yr HybridFull Time
8+ YOE8+ years designing and deploying enterprise cloud infrastructure, 4+ years in solution engineering roles, 3+ years deploying AI/ML workloads; experience with NVIDIA GPU architectures, Kubernetes, SLURM, and coding in Python/Go/C/C++.
NVIDIA, HGX, NVLink, PyTorch, NeMo, vLLM, TensorRT-LLM, SLURM, Kubernetes, Docker, Terraform, Ansible, InfiniBand, RoCE, NFS, NVMe-oF, Weka, VAST, Python, Go, C/C++, CUDA, RESTful APIs, gRPC
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Austin or San Jose or United States or Canada or Mexico
HybridFull Time
8+ YOE8+ years in DevOps/SRE or ML infrastructure (4+ supporting ML), strong Python/Scala/Java, Kubernetes on GCP/AWS, CI/CD, Terraform, Spark/Flink/Airflow/Kafka, MLflow/Chronon, observability tools, and on-call experience.
Python, Scala, Java, GCP, AWS, GKE, EKS, Kubernetes, Apache Airflow, Apache Spark, Ray, MLflow, Chronon, Aerospike, Apache Flink, Kafka, Jenkins, GitLab Runner, Terraform, Prometheus, Grafana, Datadog
1mo
Save
Mark Applied
Hide
Director of Product Management – AI Essentials
Spring or San Jose or Durham or Fort Collins or Andover
$170k-$413k/yr HybridFull Time
15+ YOE5+ MgmtBachelor's in CS/engineering required; 15+ years product experience with 5+ years leading product teams in AI/ML or data infrastructure. Experience with AI platforms, model serving, GPU ecosystems, GTM and monetization.
GenAI, GPU, MLOps, GreenLake, AI tools, AI/ML, SaaS, DevOps, agent frameworks
Explore Jobs