177 ai ml infrastructure engineer jobs at 58 companies in Corralitos, CA
2mo
Save
Mark Applied
Hide
Senior AI/ML Platform Engineer
San Mateo, California, United States
$148k-$247k/yr HybridFull Time
10+ YOE10+ years software engineering; 5+ years ML platforms/infrastructure; distributed systems; Python/Go/Java; Docker/Kubernetes; MLOps tools; cloud experience; knowledge of ML models.
Python, Go, Java, Docker, Kubernetes, MLflow, Kubeflow, SageMaker, Vertex AI, Databricks, AWS, GCP, Azure
1mo
Save
Mark Applied
Hide
ML Engineer
Palo Alto or Seattle or Paris
$139k-$226k/yr RemoteFull Time
5+ YOE5+ years applied ML/AI experience, 4+ years software engineering, experience with LLM-based systems, model lifecycle and ML infrastructure, bachelor's in CS/Engineering or equivalent, strong communication and mentoring skills.
Docker Desktop, Docker Hub, Docker Scout, LLM, MCP, Agentic Platform
1mo
Save
Mark Applied
Hide
Senior Applied AI and AI Infrastructure Engineer - Chip Design and DFX
Santa Clara, California, United States
$200k-$380k/yr OnsiteFull Time
6+ YOEAdvanced degree or equivalent experience in engineering with 6+–12+ yrs experience in AI infrastructure, applied ML/GenAI; experience with agents, SQL/ETL/data modeling, cloud (AWS/Azure/GCP), Python and C++; strong communication.
SQL, ETL, AWS, Azure, GCP, Python, C++
2mo
Save
Mark Applied
Hide
Senior Applied AI and AI Infrastructure Engineer - Chip Design and DFX
Santa Clara, California, United States
$200k-$380k/yr OnsiteFull Time
6+ YOEBSEE/MSEE/PhD with 12+/10+/6+ years experience in AI infrastructure, applied ML and Gen AI. Experience with SQL, ETL, data modeling, cloud (AWS/Azure/GCP), Python, C++, distributed systems, and mentoring.
SQL, ETL, Python, C++, AWS, Azure, GCP
1mo
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer - Model Training
Mountain View, California, United States
$190k-$260k/yr OnsiteFull Time
2+ YOEDegree in CS or related field,2+ years ML systems experience,expertise in distributed training,high-performance data pipelines,GPU performance and profiling,Python and PyTorch skills.
PyTorch, PyTorch DDP/FSDP, DeepSpeed, Megatron, NCCL, WebDataset, MosaicML Streaming, MDS, Nsight, PyTorch Profiler, Python, C++, CUDA, Triton, NVLink, InfiniBand
3d
Save
Mark Applied
Hide
Software Engineer III, AI/ML, AI and Infrastructure
Sunnyvale, California, United States
$147k-$210k/yr OnsiteFull Time
2+ YOEBachelor's degree or equivalent practical experience, 2+ years programming in Python or C++, and experience with ML infrastructure and a specialized ML area.
Python, C++, Machine Learning (ML), Machine Learning Infrastructure, Vertex AI, TPUs
1mo
Save
Mark Applied
Hide
Lead AI Infrastructure Engineer, Reinforcement Learning
Santa Clara, California, United States
$179k-$306k/yr HybridFull Time
Design and operate distributed RL training infrastructure at scale; strong systems experience in ML platforms; proficiency with PyTorch/JAX, NCCL/MPI-style distributed training, C++/Python performance tuning; Bachelor's degree required.
PyTorch, JAX, NCCL, MPI, C++, Python
6d
Save
Mark Applied
Hide
Recommendation Architecture AI/ML Infrastructure Engineer Intern (Data-Arch-TikTok Live) - 2027 Summer
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
OnsiteInternship
Pursuing a bachelor's or master's degree in AI, software development, computer science, computer engineering, or related field; strong C++ or Python skills; data structures, algorithms, systems, PyTorch or TensorFlow, and LLM knowledge.
C++, Python, PyTorch, TensorFlow, CUDA, Triton, FSDP, ZeRO, FlashAttention
1mo
Save
Mark Applied
Hide
Senior MLOps & AI Infrastructure Engineer
San Jose, California, United States
$149k-$216k/yr OnsiteFull Time
10+ YOEBachelor's degree, 10+ years ML engineering/MLOps experience, strong Python, cloud ML platforms (AWS/GCP/Azure), Docker/Kubernetes, CI/CD, ML frameworks (PyTorch/TensorFlow/JAX), experience with MLflow/W&B and HPC schedulers.
PyTorch, TensorFlow, JAX, Hugging Face, scikit-learn, XGBoost, MLflow, Kubeflow, Airflow, Weights & Biases, DVC, Feast, AWS SageMaker, GCP Vertex AI, Azure ML, Terraform, CloudFormation, Docker, Kubernetes, Slurm, LSF, Python, Bash, Go, SQL, Prometheus, Grafana, ELK Stack, Evidently AI, Arize
2w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
3d
Save
Mark Applied
Hide
Software Engineer, ML Platform
Denver or San Francisco or New York City or San Jose or Scottsdale
$160k-$240k/yr HybridFull Time
4+ YOERequires 4+ years of software engineering experience in Python, Ruby, or Java; ML infrastructure and platform-service experience; cloud-platform experience; and familiarity with AI frameworks and AI-assisted development tools.
Python, Ruby, Java, AWS, CI/CD
4w
Save
Mark Applied
Hide
Principal Engineer - AI /ML Platform
Brooklyn Park or Sunnyvale
$168k-$356k/yr HybridFull Time
MS or equivalent preferred; extensive experience designing and operating large-scale cloud-native ML platforms, Kubernetes-based infrastructure, MLOps, model governance, observability, and platform automation.
Vertex AI, Kubeflow, MLflow, Terraform, GitOps, Kubernetes, CI/CD
2mo
Save
Mark Applied
Hide
Helix AI Engineer, Backend Infrastructure
San Jose, California, United States
$150k-$400k/yr OnsiteFull Time
5+ YOESenior backend engineer skilled in high-throughput, real-time streaming, cloud systems, and ML-serving integration.
Go, C++, Python, Rust, AWS, GCP, Azure, Docker, Kubernetes, Service Mesh, CI/CD
2mo
Save
Mark Applied
Hide
Principal Engineer, Cloud Data Infrastructure
San Jose or Austin
$218k-$324k/yr HybridFull Time
10+ YOE10+ years relevant experience and a Bachelor’s degree (or equivalent); deep expertise in databases, data pipelines, messaging, caching, performance and resilience engineering; experience with real-time analytics and AI/ML infrastructure; strong technical leadership and mentoring.
1w
Save
Mark Applied
Hide
Software Engineer, AI Infrastructure
Palo Alto, California, United States
OnsiteFull Time
5+ YOE5+ years building and operating production infrastructure for ML workloads; hands-on Kubernetes on AWS or GCP (GPU workloads); strong CS fundamentals, system design, incident response, and customer-facing debugging experience.
Kubernetes, AWS, GCP
1mo
Save
Mark Applied
Hide
Sr. Staff AI Engineer - On-Prem AI Infrastructure & Agentic Systems
San Jose, California, United States
$140k-$165k/yr OnsiteFull Time
2+ YOE2+ years in AI/ML engineering with on-prem/private-cloud deployment, experience building agentic AI and RAG pipelines, model fine-tuning (LoRA/QLoRA), Python/Linux/Docker/Kubernetes proficiency, and familiarity with vector DBs and AI serving frameworks.
vLLM, TGI, Triton, Milvus, Qdrant, FAISS, Kubernetes, Helm, Docker, LangGraph, AutoGen, LoRA, QLoRA, Model Control Protocols (MCP), Python, Linux, Pinecone, Ollama, ONNX, TensorRT, GGUF, BabyAGI, LangSmith, Weights & Biases, Prometheus, Grafana, CI/CD
1mo
Save
Mark Applied
Hide
AI Platform Engineer
Milpitas, California, United States
$136k-$232k/yr OnsiteFull Time
5+ YOEDegree in CS/CE or related, 5+ years systems/DevOps/ML infrastructure experience, hands-on AI/GPU cluster and Linux/Kubernetes expertise, Python/Bash scripting, and knowledge of storage, networking, and security.
Linux, Kubernetes, Docker, Slurm, Ray, TensorFlow, PyTorch, GPU, TPU, Bash, Python, CI/CD, Infrastructure as Code (IaC), TPM
1mo
Save
Mark Applied
Hide
Senior AI Systems Engineer
San Jose, California, United States
$160k-$180k/yr OnsiteFull Time
3+ YOEBS/MS/PhD in CS or related, 3+ years building AI/ML systems or HPC/ML infrastructure, experience with multi-cloud (AWS), Docker, Kubernetes, MLflow, vLLM/SGLang, SkyPilot, SQL/NoSQL and Parquet.
MLflow, Nebius AI Cloud, Docker, Kubernetes, SkyPilot, vLLM, SGLang, SQL, NoSQL, Parquet, AWS
2mo
Save
Mark Applied
Hide
Director, Strategic Accounts - AI/ML Infrastructure
Maple Grove or San Jose
$120k-$200k/yr RemoteFull Time
10+ YOE10+ years in strategic account management or business development for AI/ML infrastructure; engineering degree; executive-level engagement experience.
Salesforce, CRM
1mo
Save
Mark Applied
Hide
Senior Software Engineer, AI Infrastructure - LVM Inference & Evaluation
Redwood City, California, United States
$168k-$205k/yr HybridFull Time
4+ YOE4+ years building infrastructure or production AI systems; strong Python; experience with ML infrastructure, LLM/LVM inference, inference optimization, evaluation frameworks, cloud and GPU workloads; BS/MS or equivalent.
Python, vLLM, Triton Inference Server, CUDA, NCCL, PyTorch, TensorRT, ONNX