83 ml infrastructure engineer jobs at 41 companies in Olympia, WA
2mo
Save
Mark Applied
Hide
ML Engineer
Palo Alto or Seattle or Paris
$139k-$226k/yr RemoteFull Time
5+ YOE5+ years applied ML/AI experience, 4+ years software engineering, experience with LLM-based systems, model lifecycle and ML infrastructure, bachelor's in CS/Engineering or equivalent, strong communication and mentoring skills.
Docker Desktop, Docker Hub, Docker Scout, LLM, MCP, Agentic Platform
3w
Save
Mark Applied
Hide
Staff/Sr. ML Infrastructure Engineer, Foundation Model Compute Infra
Seattle, Washington, United States
OnsiteFull Time
No qualifications specified in the posting.
3d
Save
Mark Applied
Hide
Senior ML Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York City or Canada or Seattle or Santa Barbara or San Diego or Toronto
$152k-$228k/yr RemoteFull Time
5+ YOE5+ years of ML engineering experience; advanced Python, PyTorch, and deep learning; production NLP model deployment; SLM/LLM fine-tuning; inference infrastructure; production APIs; MLOps and model monitoring.
Python, PyTorch, HuggingFace Transformers, spaCy, Triton Inference Server, Baseten, Kubernetes, LoRA, QLoRA, PEFT, vLLM, TGI, SageMaker, Vertex AI, Braintrust, MLflow, RLHF
4w
Save
Mark Applied
Hide
Principal Core Infrastructure Engineer
Seattle, Washington, United States
$85k-$210k/yr OnsiteFull Time
6+ YOEDesign, deploy, and manage AI/ML and HPC infrastructure; scripting and automation (Ansible,Terraform,Python); containerization (Docker,Kubernetes); strong Linux, networking, security, and troubleshooting skills.
Ansible, Terraform, Python, Kubernetes, Docker, Slurm, PBS, TensorFlow, PyTorch, scikit-learn, Jenkins, GitLab CI/CD, Prometheus, GitHub, Scala, Oracle Linux, RHEL, CentOS, Ubuntu, Debian
1mo
Save
Mark Applied
Hide
Machine Learning Infrastructure Engineer
San Francisco or New York or Los Angeles or Seattle
$200k-$345k/yr HybridFull Time
4+ YOE4+ years building ML systems,3+ years software engineering,1+ year Python,experience with databases,monitoring,cloud services and production ML deployments.
Python, PostgreSQL, DynamoDB, Elasticsearch, Redis, DataDog, Grafana, AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS, ECS, Apache Kafka, Flink
1mo
Save
Mark Applied
Hide
Member of Technical Staff - Machine Learning Infrastructure Engineer
San Francisco or Toronto or Seattle
$180k-$300k/yr OnsiteFull Time
Experienced software engineer with production ML/data infrastructure skills, proficiency with PyTorch or JAX, distributed systems, AWS/GCP, Kubernetes, data pipelines, and familiarity with transformers and inference libraries like vLLM.
PyTorch, JAX, AWS, GCP, Kubernetes, transformers, vLLM, SGLang
4d
Save
Mark Applied
Hide
Tech Lead, Machine Learning Infrastructure Engineer
Seattle or Bellevue
$198k-$416k/yr OnsiteFull Time
5+ YOEBachelor’s or master’s degree in a technical discipline; 5+ years software engineering and 3+ years ML infrastructure experience. Requires Python, C++ or Java, distributed systems, GPU clusters, Kubernetes or Slurm, PyTorch or TensorFlow, CUDA, and networking expertise.
Python, C++, Java, Kubernetes, Slurm, PyTorch, TensorFlow, CUDA, InfiniBand, RoCE, Megatron, DeepSpeed, Triton, Cutlass, TensorRT, Triton Inference Server
1mo
Save
Mark Applied
Hide
Principal Infrastructure Architect
Seattle, Washington, United States
$184k-$231k/yr HybridFull Time
10+ YOE10+ years in server/storage/infrastructure architecture; deep expertise with CPU/GPU/xPU platforms, AI/ML hardware roadmaps, CXL/DPUs/SmartNICs and storage topologies; strong communication and leadership.
CXL memory pooling, DPUs/SmartNICs, disaggregated storage, computational storage, CPU, GPU, xPU, AI/ML, 800VDC rack scale systems
2d
Save
Mark Applied
Hide
Senior Software Engineer – ML Infra
Sunnyvale or San Francisco or Seattle
$202k-$224k/yr HybridFull Time
6+ YOE6+ years developing ML models, bachelor's degree in computer science, computer engineering, or related field, AI/ML framework experience, foundational model or LLM development, and MLOps/ML infrastructure experience.
PyTorch, TensorFlow, Kubernetes, MLOps, Large Language Models (LLMs)
1mo
Save
Mark Applied
Hide
Software Engineer - AI Compute Infrastructure
Seattle, Washington, United States
OnsiteFull Time
2+ YOE2+ years building cloud/ML infrastructure; strong knowledge of large-model inference, distributed systems, scheduling, and container orchestration; proficiency in Go, Rust, Python, or C++; experience with Kubernetes and GPU orchestration.
AIBrix, Kubernetes, vLLM, SGLang, TensorRT-LLM, Docker, Ray, Go, Rust, Python, C++, CUDA, AWS, Azure, GCP, SageMaker, Azure ML, Vertex AI, DeepSpeed, PyTorch
2mo
Save
Mark Applied
Hide
Software Engineer, ML Platform
Seattle, Washington, United States
$140k-$215k/yr OnsiteFull Time
5+ YOE5+ years building and deploying ML systems, strong Python skills, experience with ML training infrastructure, Terraform/Ansible, PyTorch/JAX, and leading technical projects; degree in CS/ML/Computational Biology preferred.
Python, Terraform, Ansible, PyTorch, JAX, Slurm, Kubernetes
3w
Save
Mark Applied
Hide
Senior Software Engineer - AI / ML Platforms and Infrastructure
Seattle, Washington, United States
$168k-$210k/yr HybridFull Time
5+ YOEBachelor's or equivalent, 5+ years building AI/ML platforms, proficiency with Python, shell scripting, Git, cloud platforms, and project tools; experience with federated learning preferred.
Jira, Python, shell scripting, Git, AWS, Google Cloud, Azure
1mo
Save
Mark Applied
Hide
Software Engineer, Recommendation Infrastructure (Seattle)
Seattle, Washington, United States
$148k-$301k/yr OnsiteFull Time
3+ YOEBachelor's in CS or related,3-5 years building scalable systems,experience with C/C++,Java or Golang,knowledge of recommender/search/ML/distributed systems,strong communication and ownership.
C, C++, Java, Golang
2w
Save
Mark Applied
Hide
Staff Software Engineer - Data Cloud Applied ML
San Francisco or Seattle or New York City
$189k-$315k/yr OnsiteFull Time
8+ YOE8+ years engineering experience owning distributed systems, experience deploying and optimizing LLMs, backend skills in Python/Go/Java, and cloud-native infrastructure experience (Kubernetes).
Python, Go, Java, Kubernetes, LLMs
2mo
Save
Mark Applied
Hide
Manager, Engineering | ML Infrastructure & Tooling
Seattle, Washington, United States
$170k-$195k/yr HybridFull Time
7+ YOE3+ MgmtBS in CS or related, 7+ years software development experience with 3+ years managing teams; experience delivering machine-learning cloud infrastructure, infra-as-code, DB/SQL performance, CI/CD/DevOps, familiarity with LLMs/clustering/anomaly detection, and agile practices.
SQL, CI/CD, DevOps, LLMs, Agile, infrastructure as code
1w
Save
Mark Applied
Hide
Senior Developer Relations Engineer, GKE and AI Infrastructure
Sunnyvale or Cambridge or Kirkland or New York City or Raleigh or Durham or Seattle
$163k-$236k/yr OnsiteFull Time
5+ YOEBachelor's in CS or equivalent,5+ years technical experience,2+ years running AI/ML workloads on GPUs/TPUs with Kubernetes/GKE,2+ years producing developer content,proficiency in Python and strong programming skills.
Kubernetes, GKE, GPU, TPU, Python, C++, Java, Vertex AI, Google Cloud
2mo
Save
Mark Applied
Hide
Senior Software Engineer - Platform and Infrastructure
Glendale or Seattle or Bristol
$142k-$199k/yr HybridFull Time
5+ YOEBachelor's in computer science or related field, 5+ years technical experience, hands-on ML and production-grade software development, API integration, defensive application design, and strong technical communication.
Kinesis, Dynamo, ElastiCache, Lambda, S3, ECS, Aurora, Bedrock, JavaScript, TypeScript, Swift, Kotlin, Terraform, CloudFormation, CloudWatch, Datadog
3mo
Save
Mark Applied
Hide
AI Inference Infrastructure Software Engineer (Kubernetes / Cloud)
Seattle, Washington, United States
HybridFull Time
3+ YOE3–5 years in Kubernetes and cloud deployments; BS in CS/Software Eng; strong Python/Bash/Go; experience with Terraform/Pulumi, Ansible/Puppet, GitOps; production ML/inference on Kubernetes.
Kubernetes, AWS, GCP, Terraform, Pulumi, Ansible, GitOps, Argo CD, Flux, Python, Bash, Go, Linux
2w
Save
Mark Applied
Hide
Principal Engineer
Seattle, Washington, United States
$174k-$274k/yr HybridFull Time
5+ YOE5+ years building ML/AI infrastructure, expert ML lifecycle and large-scale system design, proficiency in Python and ML frameworks, MLOps and CI/CD experience.
Python, PyTorch, TensorFlow, JAX, Go, Java, Scala, MLOps, CI/CD, AWS, GCP, Azure, Spark, Ray, Dask
2w
Save
Mark Applied
Hide
Senior Software Engineer, Machine Learning Infrastructure - Generative AI
San Francisco or Sunnyvale or Seattle
$137k-$299k/yr OnsiteFull Time
6+ YOEB.S., M.S., or PhD in Computer Science or equivalent; 6+ years software engineering experience; Python, distributed systems, production ML infrastructure, LLM inference or fine-tuning, technical leadership, and AI coding tools.
Python, LLM, VLM, GLM, Qwen, Kimi, DeepSeek, SFT, DPO, LoRA, RLHF, RLVR, Claude Code, Codex, Cursor, vLLM, SGLang, TensorRT-LLM, Kubernetes, AWS, GCP, Modal, MCP, RAG, FP8, INT8, AWQ, GPTQ, Gem, Covey
Explore Jobs
Expand Your Job Search
Top Cities Near Olympia for ML Infrastructure Engineer
- ML Infrastructure Engineer jobs in Seattle, WA
- ML Infrastructure Engineer jobs in Tacoma, WA
- ML Infrastructure Engineer jobs in Kent, WA
- ML Infrastructure Engineer jobs in Renton, WA
- ML Infrastructure Engineer jobs in Federal Way, WA
- ML Infrastructure Engineer jobs in Auburn, WA
- ML Infrastructure Engineer jobs in Lakewood, WA
- ML Infrastructure Engineer jobs in Burien, WA
- ML Infrastructure Engineer jobs in Lacey, WA
- ML Infrastructure Engineer jobs in Puyallup, WA
- ML Infrastructure Engineer jobs in Bremerton, WA
- ML Infrastructure Engineer jobs in University Place, WA
- ML Infrastructure Engineer jobs in Des Moines, WA
- ML Infrastructure Engineer jobs in SeaTac, WA
- ML Infrastructure Engineer jobs in Maple Valley, WA
- ML Infrastructure Engineer jobs in Mercer Island, WA
- ML Infrastructure Engineer jobs in Bainbridge Island, WA
- ML Infrastructure Engineer jobs in Tukwila, WA
- ML Infrastructure Engineer jobs in Bonney Lake, WA
- ML Infrastructure Engineer jobs in Covington, WA