435 ai ml infrastructure engineer jobs at 228 companies in United States

PromotedHiringCafe
ML Engineer - Inference & Model Deployment
Cupertino, CA, US
$250k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Turn powerful AI and ML models into fast, reliable production systems. Own inference latency, throughput, model-serving architecture, multi-GPU systems, and production deployment for millions of users.
Python, PyTorch, vLLM, SGLang, TensorRT, LLMs
PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
PromotedHiringCafe
Founding Backend / Infra Engineer
Cupertino, CA, US
$160k-$300k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Own the crawlers, pipelines, and infrastructure powering a real-time job search engine. Strong Node.js and Python fundamentals; bonus points for security and reverse-engineering chops.
Node.js, Python, Elasticsearch, Redis
1mo
Save
Mark Applied
Hide
AI / ML Engineer
Bengaluru or United States
OnsiteFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
7.5+ YOE7.5+ years experience building and operating ML/AI platform infrastructure; must-have skills: Machine Learning Operations, DevOps, LLMs; experience with CI/CD, GenAI, cloud AI services; team leadership and platform observability experience.
Machine Learning Operations, DevOps, Large Language Models (LLMs), CI/CD, GenAI, Cloud AI services
3mo
Save
Mark Applied
Hide
Staff AI/ML Infrastructure Engineer
United States
$145k-$160k/yr RemoteFull Time
Vultr
Vultr: Global cloud infrastructure and bare metal server hosting provider.
5+ YOE5+ years in bare metal infrastructure, GPU platforms, Linux, and automation with Python/Bash; hardware, BIOS/firmware, and driver experience; leadership experience.
Linux, Python, Bash, NVIDIA GPUs, AMD GPUs, BIOS, BMC, Redfish/IPMI, PCIe, RoCE, InfiniBand
1mo
Save
Mark Applied
Hide
AI Infrastructure Engineer
San Jose, California, United States
$179k-$306k/yr HybridFull Time
AMD
AMDNASDAQ: AMD: Designs and manufactures computer processors and graphics technology.
5+ YOE5+ years in DevOps/platform/infrastructure engineering; deep Kubernetes experience; experience building developer-facing platforms, Helm and GitOps workflows, storage/networking for GPU workloads; Terraform, monitoring, and ML framework exposure preferred.
Kubernetes, Helm, ArgoCD, Flux, GitOps, Terraform, CSI drivers, CNI, Prometheus, Grafana, Loki, Slurm, PyTorch, vLLM, SGLang
1mo
Save
Mark Applied
Hide
AI/ML Engineeer
Hampton or Norfolk
$78k-$176k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
5+ YOE5+ years DevOps/DevSecOps experience automating CI/CD and infrastructure, scripting with Python or Linux Shell, containerization (Kubernetes/Docker), troubleshooting pipelines, AI/ML ops experience, bachelor's degree, ability to obtain Secret clearance.
Python, Linux Shell Script, Kubernetes, Docker, Jenkins, CI/CD, AIOps, ML Ops, model ops, data ops, AWS, Azure, Google Cloud Platform, ML flow
1mo
Save
Mark Applied
Hide
Senior AI ML Engineer - Remote
San Francisco or Minneapolis or Washington, D.C. or United States
$120k-$215k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
4+ YOE2+ MgmtBachelor's degree or 4+ years equivalent, 4+ years Python, 4+ years cloud infrastructure (AWS/Azure/GCP), 4+ years AI/ML infrastructure experience, 2+ years team lead, 1+ year LLM experience.
Python, AWS, Azure, GCP, Large Language Models (LLMs), GitHub, GitHub Actions, Docker, Terraform, CI/CD
3mo
Save
Mark Applied
Hide
Senior ML Infrastructure Engineer, Proactive
Cupertino or Seattle
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
Experience designing large-scale ML/AI platforms; proficiency in ML systems, LLMs, and distributed data; strong multi-threaded programming skills.
Python, Distributed systems, MacOS/iOS development, LLMs, Machine learning platforms
3mo
Save
Mark Applied
Hide
AI Infrastructure Engineer
United States
$170k-$210k/yr RemoteFull Time
Utilidata
Utilidata: Provides edge AI for power grid and data center optimization.
5+ YOE5+ years software engineering with a focus on AI infrastructure, ML model serving, distributed systems, and GPU-based deployments; Python experience; Kubernetes/Docker; travel up to 10%.
Python, C++, CUDA, Go, Rust, TensorRT, Triton, TorchServe, Kubernetes, Docker, vLLM, SGLang, Datadog, Prometheus, Grafana, Terraform, Helm
3w
Save
Mark Applied
Hide
Lead AI & ML Engineer
United States
OnsiteFull Time
Delta Air Lines
Delta Air LinesNYSE: DAL: Major US-based airline providing passenger and cargo air transport.
Lead AI/ML initiatives including identifying business problems for AI, defining frameworks and infrastructure strategy, building POCs/prototypes and reusable models, and promoting an AI-first mindset.
1w
Save
Mark Applied
Hide
AI Infrastructure Engineer
Huntsville, Alabama, United States
OnsiteFull Time
IPT Associates
IPT Associates: Provides IT and professional services to federal government agencies.
10+ YOEBachelor's in CS/Engineering/Data Science/Math,10+ years enterprise IT experience, experience with AI/ML applications, familiarity with LLM patterns, strong communication, and active security clearance.
LangChain, LangGraph, Semantic Kernel, AutoGen, CrewAI, Haystack, LlamaIndex, Python, JavaScript, TypeScript
1w
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer
Austin or Reston or United States
HybridFull Time
Seekr
Seekr: Transparent AI platform for enterprise and government decision-making.
5+ YOE5–8 years building distributed systems or cloud/platform services; production Kubernetes and ML infra experience; strong software engineering in Python and Go/Rust/C++; familiarity with GPU inference, model serving frameworks, and cloud platforms.
Kubernetes, Helm, Argo CD, Docker, Prometheus, Grafana, OpenTelemetry, Python, Go, Rust, C++, vLLM, SGLang, TensorRT-LLM, Triton Inference Server, Ray Serve, AWS, Azure, Oracle Cloud Infrastructure, Google Cloud Platform
2mo
Save
Mark Applied
Hide
Lead AI/ML Engineer
Grapevine, Texas, United States
OnsiteFull Time
GameStop
GameStopNYSE: GME: Video game, consumer electronics, and collectibles retail.
9+ YOE9+ years software development; dynamic pricing and real-time data pipelines; web scraping; AWS, Kubernetes, CI/CD; Java/Spring; e-commerce/retail tech.
AWS, Kubernetes, CI/CD, Java, Spring, Web Scraping, Cloud Infrastructure, Service-Oriented Architecture
1mo
Save
Mark Applied
Hide
Senior AI/ML Platform Engineer
San Mateo, California, United States
$148k-$247k/yr HybridFull Time
Guidewire
GuidewireNYSE: GWRE: Provides a software platform for property and casualty insurers.
10+ YOE10+ years software engineering; 5+ years ML platforms/infrastructure; distributed systems; Python/Go/Java; Docker/Kubernetes; MLOps tools; cloud experience; knowledge of ML models.
Python, Go, Java, Docker, Kubernetes, MLflow, Kubeflow, SageMaker, Vertex AI, Databricks, AWS, GCP, Azure
1mo
Save
Mark Applied
Hide
Senior AI / ML Engineer
Melbourne or San Francisco or Sydney
OnsiteFull Time
Artificial Analysis
Artificial Analysis: Independent AI benchmarking and performance analysis platform.
3+ YOE3+ years software engineering experience; strong Python, pandas and OpenAI API proficiency; experience with data-intensive backend systems, data visualization, cloud infrastructure, and leading projects end-to-end.
Python, pandas, OpenAI, PyTorch
1w
Save
Mark Applied
Hide
AI-Enabled Infrastructure and Systems Engineer
New York, New York, United States
$162k-$200k/yr HybridFull Time
BlackRock
BlackRockNYSE: BLK: Provides investment management and financial technology services globally.
5+ YOE5+ years infrastructure engineering experience; cloud (AWS/Azure/GCP) and IaC (Terraform/CloudFormation/ARM/Bicep/Ansible) proficiency; scripting (Python/Java/Golang); experience supporting AI/ML workloads and platform engineering.
Terraform, Ansible, CloudFormation, ARM/Bicep, Python, Java, Golang, AWS, Microsoft Azure ML, Microsoft Azure Foundry, AWS Bedrock, Google Vertex
1mo
Save
Mark Applied
Hide
ML Engineer
Palo Alto or Seattle or Paris
$139k-$226k/yr RemoteFull Time
Docker
Docker: Provides a platform for building, sharing, and running containerized applications.
5+ YOE5+ years applied ML/AI experience, 4+ years software engineering, experience with LLM-based systems, model lifecycle and ML infrastructure, bachelor's in CS/Engineering or equivalent, strong communication and mentoring skills.
Docker Desktop, Docker Hub, Docker Scout, LLM, MCP, Agentic Platform
1mo
Save
Mark Applied
Hide
Senior Applied AI and AI Infrastructure Engineer - Chip Design and DFX
Santa Clara, California, United States
$200k-$380k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
6+ YOEAdvanced degree or equivalent experience in engineering with 6+–12+ yrs experience in AI infrastructure, applied ML/GenAI; experience with agents, SQL/ETL/data modeling, cloud (AWS/Azure/GCP), Python and C++; strong communication.
SQL, ETL, AWS, Azure, GCP, Python, C++
1mo
Save
Mark Applied
Hide
Staff AI/ML Software Engineer, YouTube Ads Creative Foundational Infrastructure
Mountain View, California, United States
$207k-$301k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
8+ YOEBachelor's in CS or equivalent, 8+ years software development, 5+ years building large-scale infrastructure, 3+ years software design, experience with ML infrastructure; leadership and deep learning framework experience preferred.
TensorFlow, PyTorch
1mo
Save
Mark Applied
Hide
Senior Applied AI and AI Infrastructure Engineer - Chip Design and DFX
Santa Clara, California, United States
$200k-$380k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
6+ YOEBSEE/MSEE/PhD with 12+/10+/6+ years experience in AI infrastructure, applied ML and Gen AI. Experience with SQL, ETL, data modeling, cloud (AWS/Azure/GCP), Python, C++, distributed systems, and mentoring.
SQL, ETL, Python, C++, AWS, Azure, GCP
1w
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer - Model Training
Mountain View, California, United States
$190k-$260k/yr OnsiteFull Time
Kodiak Robotics
Kodiak RoboticsNASDAQ: KDK: Develops autonomous driving technology for commercial trucking and defense.
2+ YOEDegree in CS or related field,2+ years ML systems experience,expertise in distributed training,high-performance data pipelines,GPU performance and profiling,Python and PyTorch skills.
PyTorch, PyTorch DDP/FSDP, DeepSpeed, Megatron, NCCL, WebDataset, MosaicML Streaming, MDS, Nsight, PyTorch Profiler, Python, C++, CUDA, Triton, NVLink, InfiniBand
3mo
Save
Mark Applied
Hide
Senior AI/ML Capacity and Performance Engineer
Sunnyvale or Seattle
$145k-$261k/yr HybridFull Time
General Motors
General MotorsNYSE: GM: Manufactures and sells automobiles and automotive parts globally.
5+ YOE5+ years in high-scale infrastructure or ML systems; BS in Computer Science or related field; strong Python and PyTorch; Kubernetes; cloud experience; GPU/ML infra focus.
Python, PyTorch, Kubernetes, Nvidia DCGM, nvidia-smi, Grafana, AWS, GCP, Azure, BigQuery, Hugging Face, Nvidia Nsight, Nsight Compute