Half Moon Bay • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Half Moon Bay • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Half Moon Bay • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Half Moon Bay • 50 milesRemote · Hybrid · Onsite · Field · All Environments
270 ai ml infrastructure engineer jobs at 110 companies in Half Moon Bay, CA
3w
Save
Mark Applied
Hide
AI Infrastructure Engineer
San Francisco, California, United States
$150k-$220k/yr OnsiteFull Time
5+ YOE5+ years in systems or infrastructure engineering with GPU, HPC, or ML infrastructure experience; technical bachelor's or master's degree; Linux, Kubernetes, schedulers, configuration management, Python, Bash, containers, GPUs, and RDMA expertise.
Ansible, SaltStack, Git, Python, Bash, Kubernetes, NVIDIA GPU Operator, Slurm, Run:AI, enroot, pyxis, Docker, containerd, NVIDIA Container Toolkit, CUDA, cuDNN, NCCL, Fabric Manager, ROCm, RCCL, DKMS, GPUDirect RDMA, GPUDirect Storage, MOFED, DOCA, PyTorch, JAX, DCGM exporter, Prometheus, Grafana, PXE, MaaS, Packer, Foreman, Terraform, Lustre, GPFS, Weka, vLLM, Triton Inference Server, TensorRT-LLM, Nsight Systems, Nsight Compute, rocprof, perf, eBPF, EMR
1w
Save
Mark Applied
Hide
Senior AI/ML Engineer
Lisbon or Atlanta or London or San Francisco or Santiago or Sydney or Tokyo or Toronto or Australia or Canada or United States
HybridFull Time
5+ YOE5+ years of software engineering experience building production distributed systems and AI systems, with expertise in LLMs, agents, retrieval, cloud infrastructure, containers, Kubernetes, reliability, and evaluation.
LLM, Kubernetes, AWS, GCP, Azure, LangChain, LlamaIndex, Kafka, Airflow, Spark
1w
Save
Mark Applied
Hide
Senior Staff AI/ML Engineer
Santa Clara, California, United States
$131k-$261k/yr OnsiteFull Time
8+ YOEBachelor's degree and 8+ years, master's and 6+ years, or Ph.D. and 4+ years of related experience. Requires ML infrastructure, cloud, MLOps, AI governance, distributed systems, and leadership expertise.
AWS, Azure, Google Cloud, Docker, Kubernetes, Airflow, Terraform, Azure ML SDK, Azure Data Factory, Databricks, Spark, SQL, NoSQL, CI/CD
2w
Save
Mark Applied
Hide
Lead AI/ML Engineer - Remote
San Francisco, California, United States
$146k-$250k/yr RemoteFull Time
12+ YOEBachelor's degree or 4+ years equivalent experience; 12+ years software, data science, or analytics experience; 3+ years AI/ML; 4+ years Python, cloud infrastructure, and technical leadership.
Python, AWS, Azure, GCP, Google Cloud Platform, FHIR, HL7, HIPAA, GitHub, GitHub Actions, Docker, Terraform, CI/CD, Large Language Models (LLMs)
6d
Save
Mark Applied
Hide
Senior AI/ML Platform Engineer
Seattle or San Francisco or San Jose
$152k-$265k/yr OnsiteFull Time
5+ YOE5+ years in software engineering, backend infrastructure, data systems, or ML infrastructure; distributed systems and scalable design expertise; imaging model experience; API, pipeline, cloud, and production engineering experience; programming proficiency.
Python, TypeScript, C++, Go, Kafka, Spark, Flink, LLMs, MLOps
3mo
Save
Mark Applied
Hide
Senior AI/ML Platform Engineer
San Mateo, California, United States
$148k-$247k/yr HybridFull Time
10+ YOE10+ years software engineering; 5+ years ML platforms/infrastructure; distributed systems; Python/Go/Java; Docker/Kubernetes; MLOps tools; cloud experience; knowledge of ML models.
Python, Go, Java, Docker, Kubernetes, MLflow, Kubeflow, SageMaker, Vertex AI, Databricks, AWS, GCP, Azure
1mo
Save
Mark Applied
Hide
Senior AI / ML Engineer
San Francisco or Melbourne
OnsiteFull Time
3+ YOE3+ years software engineering experience, Python and pandas proficiency, OpenAI API experience, cloud infrastructure familiarity, data visualization and communication skills; Bachelor’s or Master’s preferred.
Python, pandas, OpenAI, PyTorch
1w
Save
Mark Applied
Hide
Senior Staff AI/ML Engineer
Santa Clara, California, United States
$131k-$261k/yr OnsiteFull Time
8+ YOEBachelor's degree in a related field with 8+ years, master's with 6+ years, or Ph.D. with 4+ years. Requires ML infrastructure, cloud, MLOps, distributed systems, CI/CD, and technical leadership experience.
Azure ML SDK, Azure Data Factory, Databricks, Spark, SQL, NoSQL, AWS, Azure, Google Cloud, Docker, Kubernetes, Airflow, Terraform, CI/CD, RAG, MCP, Kanban, Scrum
2mo
Save
Mark Applied
Hide
ML Engineer
Palo Alto or Seattle or Paris
$139k-$226k/yr RemoteFull Time
5+ YOE5+ years applied ML/AI experience, 4+ years software engineering, experience with LLM-based systems, model lifecycle and ML infrastructure, bachelor's in CS/Engineering or equivalent, strong communication and mentoring skills.
Docker Desktop, Docker Hub, Docker Scout, LLM, MCP, Agentic Platform
1mo
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer - Model Training
Mountain View, California, United States
$190k-$260k/yr OnsiteFull Time
2+ YOEDegree in CS or related field,2+ years ML systems experience,expertise in distributed training,high-performance data pipelines,GPU performance and profiling,Python and PyTorch skills.
PyTorch, PyTorch DDP/FSDP, DeepSpeed, Megatron, NCCL, WebDataset, MosaicML Streaming, MDS, Nsight, PyTorch Profiler, Python, C++, CUDA, Triton, NVLink, InfiniBand
1mo
Save
Mark Applied
Hide
Staff AI/ML Software Engineer, YouTube Ads Creative Foundational Infrastructure
Mountain View, California, United States
$207k-$300k/yr OnsiteFull Time
8+ YOEBachelor's degree or equivalent,8+ years software development,5+ years product launches,experience with large-scale distributed systems and ML infrastructure,EMR not mentioned,TensorFlow/PyTorch proficiency preferred.
TensorFlow, PyTorch
3mo
Save
Mark Applied
Hide
Software Engineer, AI/ML (Infrastructure & Platform)
New York City or Tempe or San Francisco
$200k-$235k/yr HybridFull Time
Build AI infrastructure and platform software; strong software engineering, distributed systems, production AI experience.
Python, TypeScript, C#, APIs, Distributed Systems, LLM/AI Systems, Tool/Skill Abstractions, LangChain, Data Pipelines
1mo
Save
Mark Applied
Hide
Lead AI Infrastructure Engineer, Reinforcement Learning
Santa Clara, California, United States
$179k-$306k/yr HybridFull Time
Design and operate distributed RL training infrastructure at scale; strong systems experience in ML platforms; proficiency with PyTorch/JAX, NCCL/MPI-style distributed training, C++/Python performance tuning; Bachelor's degree required.
PyTorch, JAX, NCCL, MPI, C++, Python
3w
Save
Mark Applied
Hide
Recommendation Architecture AI/ML Infrastructure Engineer Intern (Data-Arch-TikTok Live) - 2027 Summer
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
OnsiteInternship
Pursuing a bachelor's or master's degree in AI, software development, computer science, computer engineering, or related field; strong C++ or Python skills; data structures, algorithms, systems, PyTorch or TensorFlow, and LLM knowledge.
C++, Python, PyTorch, TensorFlow, CUDA, Triton, FSDP, ZeRO, FlashAttention
1mo
Save
Mark Applied
Hide
Lead AI/ML Engineer (GenAI & Agentic Systems)-iCloud
San Francisco, California, United States
OnsiteFull Time
Technical leadership applying production LLM systems, retrieval-assisted generation (RAG), agentic workflows, skills-based automation, evaluation and orchestration frameworks to improve cloud infrastructure efficiency and engineering productivity.
LLM, Retrieval-assisted generation (RAG), iCloud, Apple Intelligence, Private Cloud Compute (PCC)
2mo
Save
Mark Applied
Hide
Founding Engineer, AI Infra
San Francisco, California, United States
HybridFull Time
5+ YOE5+ years building or operating ML infrastructure; deep GPU and distributed training knowledge; experience with PyTorch/DeepSpeed/Megatron/Ray, inference stacks (vLLM, TGI, Triton), Python and C++/Rust/Go, Kubernetes and IaC, and observability tooling.
FlashAttention, CUDA, Triton, PyTorch, DeepSpeed, Megatron, Ray, vLLM, SGLang, TGI, Python, C++, Rust, Go, Kubernetes, Terraform, Pulumi, Prometheus, Grafana, OpenTelemetry, Llama 3, Qwen, DeepSeek
3mo
Save
Mark Applied
Hide
Infrastructure Engineer
New York or San Francisco or United States
$165k-$200k/yr HybridFull Time
Kubernetes production experience; IaC (Terraform/Helm); cloud (AWS/GCP); Python/Node.js; CI/CD (GitHub Actions/Spacelift); security and ML/AI infrastructure familiarity.
Kubernetes, Terraform, Helm, Python, Node.js, GitHub Actions, Spacelift, AWS, GCP, PyTorch, TensorFlow, Bash
2mo
Save
Mark Applied
Hide
Senior Infrastructure Engineer – Bazel Remote Execution
Santa Clara, California, United States
$184k-$357k/yr RemoteFull Time
8+ YOEBachelor's degree or equivalent experience, 8+ years in infrastructure development, scalable cloud infrastructure expertise, AI/ML and data analytics background, and strong object-oriented programming skills in Java or Go.
Kubernetes, Java, Go, Bazel Remote Execution, Buildbarn, Buildfarm
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
4mo
Save
Mark Applied
Hide
AI Engineer
San Francisco, California, United States
$150k-$210k/yr OnsiteFull Time
3+ YOE3+ years software engineering with focus on AI/ML or automation; hands-on AI-powered applications; experience with agentic AI concepts, LLMs, and modern AI frameworks; cloud infrastructure (AWS); backend (Node.js); frontend (React).
Claude, OpenAI, LangChain, n8n, AWS, Node.js, React, MongoDB, PostgreSQL, MySQL, S3, ECS, Lambda, REST APIs, GitHub