62 ai ml infrastructure engineer jobs at 47 companies in Cotati, CA
6d
Save
Mark Applied
Hide
AI Infrastructure Engineer
San Francisco, California, United States
$150k-$220k/yr OnsiteFull Time
5+ YOE5+ years in systems or infrastructure engineering with GPU, HPC, or ML infrastructure experience; technical bachelor's or master's degree; Linux, Kubernetes, schedulers, configuration management, Python, Bash, containers, GPUs, and RDMA expertise.
Ansible, SaltStack, Git, Python, Bash, Kubernetes, NVIDIA GPU Operator, Slurm, Run:AI, enroot, pyxis, Docker, containerd, NVIDIA Container Toolkit, CUDA, cuDNN, NCCL, Fabric Manager, ROCm, RCCL, DKMS, GPUDirect RDMA, GPUDirect Storage, MOFED, DOCA, PyTorch, JAX, DCGM exporter, Prometheus, Grafana, PXE, MaaS, Packer, Foreman, Terraform, Lustre, GPFS, Weka, vLLM, Triton Inference Server, TensorRT-LLM, Nsight Systems, Nsight Compute, rocprof, perf, eBPF, EMR
2mo
Save
Mark Applied
Hide
Senior AI ML Engineer - Remote
San Francisco or Minneapolis or Washington, D.C. or United States
$120k-$215k/yr RemoteFull Time
4+ YOE2+ MgmtBachelor's degree or 4+ years equivalent, 4+ years Python, 4+ years cloud infrastructure (AWS/Azure/GCP), 4+ years AI/ML infrastructure experience, 2+ years team lead, 1+ year LLM experience.
Python, AWS, Azure, GCP, Large Language Models (LLMs), GitHub, GitHub Actions, Docker, Terraform, CI/CD
2w
Save
Mark Applied
Hide
Senior AI / ML Engineer
San Francisco or Melbourne
OnsiteFull Time
3+ YOE3+ years software engineering experience, Python and pandas proficiency, OpenAI API experience, cloud infrastructure familiarity, data visualization and communication skills; Bachelor’s or Master’s preferred.
Python, pandas, OpenAI, PyTorch
3mo
Save
Mark Applied
Hide
Software Engineer, AI/ML (Infrastructure & Platform)
New York City or Tempe or San Francisco
$200k-$235k/yr HybridFull Time
Build AI infrastructure and platform software; strong software engineering, distributed systems, production AI experience.
Python, TypeScript, C#, APIs, Distributed Systems, LLM/AI Systems, Tool/Skill Abstractions, LangChain, Data Pipelines
1mo
Save
Mark Applied
Hide
Lead AI/ML Engineer (GenAI & Agentic Systems)-iCloud
San Francisco, California, United States
OnsiteFull Time
Technical leadership applying production LLM systems, retrieval-assisted generation (RAG), agentic workflows, skills-based automation, evaluation and orchestration frameworks to improve cloud infrastructure efficiency and engineering productivity.
LLM, Retrieval-assisted generation (RAG), iCloud, Apple Intelligence, Private Cloud Compute (PCC)
2mo
Save
Mark Applied
Hide
Infrastructure Engineer
New York or San Francisco or United States
$165k-$200k/yr HybridFull Time
Kubernetes production experience; IaC (Terraform/Helm); cloud (AWS/GCP); Python/Node.js; CI/CD (GitHub Actions/Spacelift); security and ML/AI infrastructure familiarity.
Kubernetes, Terraform, Helm, Python, Node.js, GitHub Actions, Spacelift, AWS, GCP, PyTorch, TensorFlow, Bash
2mo
Save
Mark Applied
Hide
Founding Engineer, AI Infra
San Francisco, California, United States
HybridFull Time
5+ YOE5+ years building or operating ML infrastructure; deep GPU and distributed training knowledge; experience with PyTorch/DeepSpeed/Megatron/Ray, inference stacks (vLLM, TGI, Triton), Python and C++/Rust/Go, Kubernetes and IaC, and observability tooling.
FlashAttention, CUDA, Triton, PyTorch, DeepSpeed, Megatron, Ray, vLLM, SGLang, TGI, Python, C++, Rust, Go, Kubernetes, Terraform, Pulumi, Prometheus, Grafana, OpenTelemetry, Llama 3, Qwen, DeepSeek
3mo
Save
Mark Applied
Hide
AI Engineer
San Francisco, California, United States
$150k-$210k/yr OnsiteFull Time
3+ YOE3+ years software engineering with focus on AI/ML or automation; hands-on AI-powered applications; experience with agentic AI concepts, LLMs, and modern AI frameworks; cloud infrastructure (AWS); backend (Node.js); frontend (React).
Claude, OpenAI, LangChain, n8n, AWS, Node.js, React, MongoDB, PostgreSQL, MySQL, S3, ECS, Lambda, REST APIs, GitHub
1d
Save
Mark Applied
Hide
Software Engineer, ML Platform
Denver or San Francisco or New York City or San Jose or Scottsdale
$160k-$240k/yr HybridFull Time
4+ YOERequires 4+ years of software engineering experience in Python, Ruby, or Java; ML infrastructure and platform-service experience; cloud-platform experience; and familiarity with AI frameworks and AI-assisted development tools.
Python, Ruby, Java, AWS, CI/CD
3mo
Save
Mark Applied
Hide
AI/ML Infrastructure Engineer
San Francisco, California, United States
OnsiteFull Time
BS/MS/PhD in CS or EE; strong C/C++ and Python; model optimization, quantization, pruning; GPU performance tuning; profiling tools; cross-functional collaboration.
C/C++, Python, Nsight Systems, Nsight Compute, PyTorch, CUDA, TensorRT, NVIDIA DeepStream, DALI, FFmpeg, TVM, MLIR, ONNX Runtime, Triton
2mo
Save
Mark Applied
Hide
Software Engineer, AI/ML Infrastructure (US-Based)
San Francisco, California, United States
RemoteFull Time
3+ YOE1-3 years software engineering; strong data structures/algorithms; Go and Python; Postgres or DynamoDB; AI tooling; adaptable in fast-paced environment.
Go, Python, PostgreSQL, DynamoDB
1d
Save
Mark Applied
Hide
Founding Forward Deployed AI Engineer
Seattle or Bellevue or United States or San Francisco Bay Area
HybridFull Time
Stealth AI Startup: Building infrastructure to deploy and manage enterprise AI applications.
5+ YOE5+ years engineering experience, AI/ML infrastructure or MLOps expertise, cloud-native systems knowledge, Python and a systems or backend language, debugging ability, and strong customer-facing communication.
Python, Kubernetes
5h
Save
Mark Applied
Hide
Staff AI Platform Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York or Seattle or Toronto or Santa Barbara or San Diego
$180k-$273k/yr RemoteFull Time
7+ YOERequires 7+ years in AI/ML platform engineering, strong Python and/or TypeScript, distributed systems, APIs, evaluation, observability, and AI infrastructure experience; bachelor's degree or equivalent practical experience.
Python, TypeScript, JavaScript, React, Kubernetes, Docker, Terraform, LangChain, LangGraph, LlamaIndex, LiveKit, REST, gRPC, MCP, A2A
1mo
Save
Mark Applied
Hide
Principal Infrastructure Architect
San Francisco or Seattle
$184k-$231k/yr RemoteFull Time
10+ YOE10+ years in server/storage/infrastructure architecture; deep expertise with CPU/GPU/xPU platforms, AI/ML hardware roadmaps, CXL, DPUs/SmartNICs, disaggregated and computational storage; PoC leadership and strong cross-functional communication.
CPU, GPU, xPU, AI/ML, CXL memory pooling, DPUs/SmartNICs, disaggregated storage, computational storage
1mo
Save
Mark Applied
Hide
Staff AI Enablement Engineer
San Francisco, California, United States
$250k-$315k/yr HybridFull Time
8+ YOE8+ years software engineering experience with 3+ years on AI/ML or LLM infrastructure; hands-on experience with LLMs, RAG, fine-tuning, prompt engineering, function calling, and agentic workflows; strong engineering fundamentals and production experience.
LLMs, RAG
6d
Save
Mark Applied
Hide
Senior AI Developer
Montreal or San Francisco or Bangalore
$137k-$205k/yr HybridFull Time
3+ YOEBachelor's degree in computer science, engineering, or related field; 3+ years operating cloud services, infrastructure, and APIs; production ML experience; observability and CI/CD experience.
AWS, Claude, LangSmith, LangChain, LangGraph, MLflow, Anthropic, Gemini, Bedrock, Docker, Kubernetes, ECS, EKS, Temporal, Step Functions, Databricks, IAM, Terraform, CI/CD, LLMs, VLMs, SRE
3mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Cambridge or Richmond or McLean or New York or San Jose or San Francisco
$286k-$392k/yr RemoteFull Time
10+ YOE10+ years AI/ML engineering; Python/Go/Scala/Java; distributed compute; CPU/GPU infrastructure; ML/AI workloads.
Python, Go, Scala, Java, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda
1w
Save
Mark Applied
Hide
Senior Software Engineer, Machine Learning Infrastructure - Generative AI
San Francisco or Sunnyvale or Seattle
$137k-$299k/yr OnsiteFull Time
6+ YOEB.S., M.S., or PhD in Computer Science or equivalent; 6+ years software engineering experience; Python, distributed systems, production ML infrastructure, LLM inference or fine-tuning, technical leadership, and AI coding tools.
Python, LLM, VLM, GLM, Qwen, Kimi, DeepSeek, SFT, DPO, LoRA, RLHF, RLVR, Claude Code, Codex, Cursor, vLLM, SGLang, TensorRT-LLM, Kubernetes, AWS, GCP, Modal, MCP, RAG, FP8, INT8, AWQ, GPTQ, Gem, Covey
2mo
Save
Mark Applied
Hide
Member of Technical Staff - Infrastructure Engineer, Frontier AI & Robotics (FAR)
San Francisco, California, United States
$150k-$300k/yr OnsiteFull Time
5+ YOE5+ years distributed systems experience, Bachelor's in Computer Science or related, proficiency in Python and a systems/backend language (Go, Java, C++), cloud platform experience (AWS/GCP/Azure), data pipeline/ML infra experience, and familiarity with reliability and on-call practices.
Python, Go, Java, C++, AWS, GCP, Azure, Apache Spark, Flink, Ray
2mo
Save
Mark Applied
Hide
Principal Engineer, AI Platform
San Francisco or Palo Alto or United States
$243k-$500k/yr HybridFull Time
Deep expertise in AI/ML infrastructure and distributed systems; hands-on experience building production-grade systems at scale; proficiency in C++, Java, or Rust; bachelor’s degree in computer science or related field; proven cross-organizational leadership.
C++, Java, Rust