192 ai ml infrastructure engineer jobs at 88 companies in Larkspur, CA
2w
Save
Mark Applied
Hide
AI Infrastructure Engineer
San Francisco, California, United States
$150k-$220k/yr OnsiteFull Time
5+ YOE5+ years in systems or infrastructure engineering with GPU, HPC, or ML infrastructure experience; technical bachelor's or master's degree; Linux, Kubernetes, schedulers, configuration management, Python, Bash, containers, GPUs, and RDMA expertise.
Ansible, SaltStack, Git, Python, Bash, Kubernetes, NVIDIA GPU Operator, Slurm, Run:AI, enroot, pyxis, Docker, containerd, NVIDIA Container Toolkit, CUDA, cuDNN, NCCL, Fabric Manager, ROCm, RCCL, DKMS, GPUDirect RDMA, GPUDirect Storage, MOFED, DOCA, PyTorch, JAX, DCGM exporter, Prometheus, Grafana, PXE, MaaS, Packer, Foreman, Terraform, Lustre, GPFS, Weka, vLLM, Triton Inference Server, TensorRT-LLM, Nsight Systems, Nsight Compute, rocprof, perf, eBPF, EMR
1w
Save
Mark Applied
Hide
Senior AI/ML Engineer
Lisbon or Atlanta or London or San Francisco or Santiago or Sydney or Tokyo or Toronto or Australia or Canada or United States
HybridFull Time
5+ YOE5+ years of software engineering experience building production distributed systems and AI systems, with expertise in LLMs, agents, retrieval, cloud infrastructure, containers, Kubernetes, reliability, and evaluation.
LLM, Kubernetes, AWS, GCP, Azure, LangChain, LlamaIndex, Kafka, Airflow, Spark
2w
Save
Mark Applied
Hide
Lead AI/ML Engineer - Remote
San Francisco, California, United States
$146k-$250k/yr RemoteFull Time
12+ YOEBachelor's degree or 4+ years equivalent experience; 12+ years software, data science, or analytics experience; 3+ years AI/ML; 4+ years Python, cloud infrastructure, and technical leadership.
Python, AWS, Azure, GCP, Google Cloud Platform, FHIR, HL7, HIPAA, GitHub, GitHub Actions, Docker, Terraform, CI/CD, Large Language Models (LLMs)
2d
Save
Mark Applied
Hide
Senior AI/ML Platform Engineer
Seattle or San Francisco or San Jose
$152k-$265k/yr OnsiteFull Time
5+ YOE5+ years in software engineering, backend infrastructure, data systems, or ML infrastructure; distributed systems and scalable design expertise; imaging model experience; API, pipeline, cloud, and production engineering experience; programming proficiency.
Python, TypeScript, C++, Go, Kafka, Spark, Flink, LLMs, MLOps
2mo
Save
Mark Applied
Hide
Senior AI/ML Platform Engineer
San Mateo, California, United States
$148k-$247k/yr HybridFull Time
10+ YOE10+ years software engineering; 5+ years ML platforms/infrastructure; distributed systems; Python/Go/Java; Docker/Kubernetes; MLOps tools; cloud experience; knowledge of ML models.
Python, Go, Java, Docker, Kubernetes, MLflow, Kubeflow, SageMaker, Vertex AI, Databricks, AWS, GCP, Azure
4w
Save
Mark Applied
Hide
Senior AI / ML Engineer
San Francisco or Melbourne
OnsiteFull Time
3+ YOE3+ years software engineering experience, Python and pandas proficiency, OpenAI API experience, cloud infrastructure familiarity, data visualization and communication skills; Bachelor’s or Master’s preferred.
Python, pandas, OpenAI, PyTorch
2mo
Save
Mark Applied
Hide
ML Engineer
Palo Alto or Seattle or Paris
$139k-$226k/yr RemoteFull Time
5+ YOE5+ years applied ML/AI experience, 4+ years software engineering, experience with LLM-based systems, model lifecycle and ML infrastructure, bachelor's in CS/Engineering or equivalent, strong communication and mentoring skills.
Docker Desktop, Docker Hub, Docker Scout, LLM, MCP, Agentic Platform
1mo
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer - Model Training
Mountain View, California, United States
$190k-$260k/yr OnsiteFull Time
2+ YOEDegree in CS or related field,2+ years ML systems experience,expertise in distributed training,high-performance data pipelines,GPU performance and profiling,Python and PyTorch skills.
PyTorch, PyTorch DDP/FSDP, DeepSpeed, Megatron, NCCL, WebDataset, MosaicML Streaming, MDS, Nsight, PyTorch Profiler, Python, C++, CUDA, Triton, NVLink, InfiniBand
1mo
Save
Mark Applied
Hide
Staff AI/ML Software Engineer, YouTube Ads Creative Foundational Infrastructure
Mountain View, California, United States
$207k-$300k/yr OnsiteFull Time
8+ YOEBachelor's degree or equivalent,8+ years software development,5+ years product launches,experience with large-scale distributed systems and ML infrastructure,EMR not mentioned,TensorFlow/PyTorch proficiency preferred.
TensorFlow, PyTorch
1mo
Save
Mark Applied
Hide
Lead AI Infrastructure Engineer, Reinforcement Learning
Santa Clara, California, United States
$179k-$306k/yr HybridFull Time
Design and operate distributed RL training infrastructure at scale; strong systems experience in ML platforms; proficiency with PyTorch/JAX, NCCL/MPI-style distributed training, C++/Python performance tuning; Bachelor's degree required.
PyTorch, JAX, NCCL, MPI, C++, Python
3mo
Save
Mark Applied
Hide
Software Engineer, AI/ML (Infrastructure & Platform)
New York City or Tempe or San Francisco
$200k-$235k/yr HybridFull Time
Build AI infrastructure and platform software; strong software engineering, distributed systems, production AI experience.
Python, TypeScript, C#, APIs, Distributed Systems, LLM/AI Systems, Tool/Skill Abstractions, LangChain, Data Pipelines
3mo
Save
Mark Applied
Hide
Infrastructure Engineer
New York or San Francisco or United States
$165k-$200k/yr HybridFull Time
Kubernetes production experience; IaC (Terraform/Helm); cloud (AWS/GCP); Python/Node.js; CI/CD (GitHub Actions/Spacelift); security and ML/AI infrastructure familiarity.
Kubernetes, Terraform, Helm, Python, Node.js, GitHub Actions, Spacelift, AWS, GCP, PyTorch, TensorFlow, Bash
2mo
Save
Mark Applied
Hide
Founding Engineer, AI Infra
San Francisco, California, United States
HybridFull Time
5+ YOE5+ years building or operating ML infrastructure; deep GPU and distributed training knowledge; experience with PyTorch/DeepSpeed/Megatron/Ray, inference stacks (vLLM, TGI, Triton), Python and C++/Rust/Go, Kubernetes and IaC, and observability tooling.
FlashAttention, CUDA, Triton, PyTorch, DeepSpeed, Megatron, Ray, vLLM, SGLang, TGI, Python, C++, Rust, Go, Kubernetes, Terraform, Pulumi, Prometheus, Grafana, OpenTelemetry, Llama 3, Qwen, DeepSeek
1mo
Save
Mark Applied
Hide
Lead AI/ML Engineer (GenAI & Agentic Systems)-iCloud
San Francisco, California, United States
OnsiteFull Time
Technical leadership applying production LLM systems, retrieval-assisted generation (RAG), agentic workflows, skills-based automation, evaluation and orchestration frameworks to improve cloud infrastructure efficiency and engineering productivity.
LLM, Retrieval-assisted generation (RAG), iCloud, Apple Intelligence, Private Cloud Compute (PCC)
4w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
3mo
Save
Mark Applied
Hide
AI Engineer
San Francisco, California, United States
$150k-$210k/yr OnsiteFull Time
3+ YOE3+ years software engineering with focus on AI/ML or automation; hands-on AI-powered applications; experience with agentic AI concepts, LLMs, and modern AI frameworks; cloud infrastructure (AWS); backend (Node.js); frontend (React).
Claude, OpenAI, LangChain, n8n, AWS, Node.js, React, MongoDB, PostgreSQL, MySQL, S3, ECS, Lambda, REST APIs, GitHub
2w
Save
Mark Applied
Hide
Software Engineer, ML Platform
Denver or San Francisco or New York City or San Jose or Scottsdale
$160k-$240k/yr HybridFull Time
4+ YOERequires 4+ years of software engineering experience in Python, Ruby, or Java; ML infrastructure and platform-service experience; cloud-platform experience; and familiarity with AI frameworks and AI-assisted development tools.
Python, Ruby, Java, AWS, CI/CD
3w
Save
Mark Applied
Hide
Software Engineer, AI Infrastructure
Palo Alto, California, United States
OnsiteFull Time
5+ YOE5+ years building and operating production infrastructure for ML workloads; hands-on Kubernetes on AWS or GCP (GPU workloads); strong CS fundamentals, system design, incident response, and customer-facing debugging experience.
Kubernetes, AWS, GCP
3mo
Save
Mark Applied
Hide
AI/ML Infrastructure Engineer
San Francisco, California, United States
OnsiteFull Time
BS/MS/PhD in CS or EE; strong C/C++ and Python; model optimization, quantization, pruning; GPU performance tuning; profiling tools; cross-functional collaboration.
C/C++, Python, Nsight Systems, Nsight Compute, PyTorch, CUDA, TensorRT, NVIDIA DeepStream, DALI, FFmpeg, TVM, MLIR, ONNX Runtime, Triton
1mo
Save
Mark Applied
Hide
AI Platform Engineer
Milpitas, California, United States
$136k-$232k/yr OnsiteFull Time
5+ YOEDegree in CS/CE or related, 5+ years systems/DevOps/ML infrastructure experience, hands-on AI/GPU cluster and Linux/Kubernetes expertise, Python/Bash scripting, and knowledge of storage, networking, and security.
Linux, Kubernetes, Docker, Slurm, Ray, TensorFlow, PyTorch, GPU, TPU, Bash, Python, CI/CD, Infrastructure as Code (IaC), TPM