182 ai ml infrastructure engineer jobs at 81 companies in Ross, CA
1w
Save
Mark Applied
Hide
AI Infrastructure Engineer
San Francisco, California, United States
$150k-$220k/yr OnsiteFull Time
5+ YOE5+ years in systems or infrastructure engineering with GPU, HPC, or ML infrastructure experience; technical bachelor's or master's degree; Linux, Kubernetes, schedulers, configuration management, Python, Bash, containers, GPUs, and RDMA expertise.
Ansible, SaltStack, Git, Python, Bash, Kubernetes, NVIDIA GPU Operator, Slurm, Run:AI, enroot, pyxis, Docker, containerd, NVIDIA Container Toolkit, CUDA, cuDNN, NCCL, Fabric Manager, ROCm, RCCL, DKMS, GPUDirect RDMA, GPUDirect Storage, MOFED, DOCA, PyTorch, JAX, DCGM exporter, Prometheus, Grafana, PXE, MaaS, Packer, Foreman, Terraform, Lustre, GPFS, Weka, vLLM, Triton Inference Server, TensorRT-LLM, Nsight Systems, Nsight Compute, rocprof, perf, eBPF, EMR
2mo
Save
Mark Applied
Hide
Senior AI ML Engineer - Remote
San Francisco or Minneapolis or Washington, D.C. or United States
$120k-$215k/yr RemoteFull Time
4+ YOE2+ MgmtBachelor's degree or 4+ years equivalent, 4+ years Python, 4+ years cloud infrastructure (AWS/Azure/GCP), 4+ years AI/ML infrastructure experience, 2+ years team lead, 1+ year LLM experience.
Python, AWS, Azure, GCP, Large Language Models (LLMs), GitHub, GitHub Actions, Docker, Terraform, CI/CD
2mo
Save
Mark Applied
Hide
Senior AI/ML Platform Engineer
San Mateo, California, United States
$148k-$247k/yr HybridFull Time
10+ YOE10+ years software engineering; 5+ years ML platforms/infrastructure; distributed systems; Python/Go/Java; Docker/Kubernetes; MLOps tools; cloud experience; knowledge of ML models.
Python, Go, Java, Docker, Kubernetes, MLflow, Kubeflow, SageMaker, Vertex AI, Databricks, AWS, GCP, Azure
2w
Save
Mark Applied
Hide
Senior AI / ML Engineer
San Francisco or Melbourne
OnsiteFull Time
3+ YOE3+ years software engineering experience, Python and pandas proficiency, OpenAI API experience, cloud infrastructure familiarity, data visualization and communication skills; Bachelor’s or Master’s preferred.
Python, pandas, OpenAI, PyTorch
1mo
Save
Mark Applied
Hide
ML Engineer
Palo Alto or Seattle or Paris
$139k-$226k/yr RemoteFull Time
5+ YOE5+ years applied ML/AI experience, 4+ years software engineering, experience with LLM-based systems, model lifecycle and ML infrastructure, bachelor's in CS/Engineering or equivalent, strong communication and mentoring skills.
Docker Desktop, Docker Hub, Docker Scout, LLM, MCP, Agentic Platform
1mo
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer - Model Training
Mountain View, California, United States
$190k-$260k/yr OnsiteFull Time
2+ YOEDegree in CS or related field,2+ years ML systems experience,expertise in distributed training,high-performance data pipelines,GPU performance and profiling,Python and PyTorch skills.
PyTorch, PyTorch DDP/FSDP, DeepSpeed, Megatron, NCCL, WebDataset, MosaicML Streaming, MDS, Nsight, PyTorch Profiler, Python, C++, CUDA, Triton, NVLink, InfiniBand
3d
Save
Mark Applied
Hide
Software Engineer III, AI/ML, AI and Infrastructure
Sunnyvale, California, United States
$147k-$210k/yr OnsiteFull Time
2+ YOEBachelor's degree or equivalent practical experience, 2+ years programming in Python or C++, and experience with ML infrastructure and a specialized ML area.
Python, C++, Machine Learning (ML), Machine Learning Infrastructure, Vertex AI, TPUs
3mo
Save
Mark Applied
Hide
Software Engineer, AI/ML (Infrastructure & Platform)
New York City or Tempe or San Francisco
$200k-$235k/yr HybridFull Time
Build AI infrastructure and platform software; strong software engineering, distributed systems, production AI experience.
Python, TypeScript, C#, APIs, Distributed Systems, LLM/AI Systems, Tool/Skill Abstractions, LangChain, Data Pipelines
1mo
Save
Mark Applied
Hide
Lead AI/ML Engineer (GenAI & Agentic Systems)-iCloud
San Francisco, California, United States
OnsiteFull Time
Technical leadership applying production LLM systems, retrieval-assisted generation (RAG), agentic workflows, skills-based automation, evaluation and orchestration frameworks to improve cloud infrastructure efficiency and engineering productivity.
LLM, Retrieval-assisted generation (RAG), iCloud, Apple Intelligence, Private Cloud Compute (PCC)
3mo
Save
Mark Applied
Hide
Infrastructure Engineer
New York or San Francisco or United States
$165k-$200k/yr HybridFull Time
Kubernetes production experience; IaC (Terraform/Helm); cloud (AWS/GCP); Python/Node.js; CI/CD (GitHub Actions/Spacelift); security and ML/AI infrastructure familiarity.
Kubernetes, Terraform, Helm, Python, Node.js, GitHub Actions, Spacelift, AWS, GCP, PyTorch, TensorFlow, Bash
2mo
Save
Mark Applied
Hide
Founding Engineer, AI Infra
San Francisco, California, United States
HybridFull Time
5+ YOE5+ years building or operating ML infrastructure; deep GPU and distributed training knowledge; experience with PyTorch/DeepSpeed/Megatron/Ray, inference stacks (vLLM, TGI, Triton), Python and C++/Rust/Go, Kubernetes and IaC, and observability tooling.
FlashAttention, CUDA, Triton, PyTorch, DeepSpeed, Megatron, Ray, vLLM, SGLang, TGI, Python, C++, Rust, Go, Kubernetes, Terraform, Pulumi, Prometheus, Grafana, OpenTelemetry, Llama 3, Qwen, DeepSeek
2w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
3mo
Save
Mark Applied
Hide
AI Engineer
San Francisco, California, United States
$150k-$210k/yr OnsiteFull Time
3+ YOE3+ years software engineering with focus on AI/ML or automation; hands-on AI-powered applications; experience with agentic AI concepts, LLMs, and modern AI frameworks; cloud infrastructure (AWS); backend (Node.js); frontend (React).
Claude, OpenAI, LangChain, n8n, AWS, Node.js, React, MongoDB, PostgreSQL, MySQL, S3, ECS, Lambda, REST APIs, GitHub
3d
Save
Mark Applied
Hide
Software Engineer, ML Platform
Denver or San Francisco or New York City or San Jose or Scottsdale
$160k-$240k/yr HybridFull Time
4+ YOERequires 4+ years of software engineering experience in Python, Ruby, or Java; ML infrastructure and platform-service experience; cloud-platform experience; and familiarity with AI frameworks and AI-assisted development tools.
Python, Ruby, Java, AWS, CI/CD
1mo
Save
Mark Applied
Hide
Principal Engineer - AI /ML Platform
Brooklyn Park or Sunnyvale
$168k-$356k/yr HybridFull Time
MS or equivalent preferred; extensive experience designing and operating large-scale cloud-native ML platforms, Kubernetes-based infrastructure, MLOps, model governance, observability, and platform automation.
Vertex AI, Kubeflow, MLflow, Terraform, GitOps, Kubernetes, CI/CD
3mo
Save
Mark Applied
Hide
AI/ML Infrastructure Engineer
San Francisco, California, United States
OnsiteFull Time
BS/MS/PhD in CS or EE; strong C/C++ and Python; model optimization, quantization, pruning; GPU performance tuning; profiling tools; cross-functional collaboration.
C/C++, Python, Nsight Systems, Nsight Compute, PyTorch, CUDA, TensorRT, NVIDIA DeepStream, DALI, FFmpeg, TVM, MLIR, ONNX Runtime, Triton
1w
Save
Mark Applied
Hide
Software Engineer, AI Infrastructure
Palo Alto, California, United States
OnsiteFull Time
5+ YOE5+ years building and operating production infrastructure for ML workloads; hands-on Kubernetes on AWS or GCP (GPU workloads); strong CS fundamentals, system design, incident response, and customer-facing debugging experience.
Kubernetes, AWS, GCP
3mo
Save
Mark Applied
Hide
Software Engineer, AI/ML Infrastructure (US-Based)
San Francisco, California, United States
RemoteFull Time
3+ YOE1-3 years software engineering; strong data structures/algorithms; Go and Python; Postgres or DynamoDB; AI tooling; adaptable in fast-paced environment.
Go, Python, PostgreSQL, DynamoDB
3d
Save
Mark Applied
Hide
Founding Forward Deployed AI Engineer
Seattle or Bellevue or United States or San Francisco Bay Area
HybridFull Time
Stealth AI Startup: Building infrastructure to deploy and manage enterprise AI applications.
5+ YOE5+ years engineering experience, AI/ML infrastructure or MLOps expertise, cloud-native systems knowledge, Python and a systems or backend language, debugging ability, and strong customer-facing communication.
Python, Kubernetes
1mo
Save
Mark Applied
Hide
Senior Software Engineer, AI Infrastructure - LVM Inference & Evaluation
Redwood City, California, United States
$168k-$205k/yr HybridFull Time
4+ YOE4+ years building infrastructure or production AI systems; strong Python; experience with ML infrastructure, LLM/LVM inference, inference optimization, evaluation frameworks, cloud and GPU workloads; BS/MS or equivalent.
Python, vLLM, Triton Inference Server, CUDA, NCCL, PyTorch, TensorRT, ONNX