1,996 ai infrastructure engineer jobs at 931 companies in United States
2d
Save
Mark Applied
Hide
AI Infrastructure Engineer
New York City, New York, United States
$215k-$350k/yr HybridFull Time
Linux infrastructure administration, KVM or containerization, DevOps toolchains, Python or Bash automation, GPU-based compute or AI/ML infrastructure; bachelor's degree preferred.
Linux, KVM, Docker, Kubernetes, Python, Bash, FortiGate, FortiManager, FortiAnalyzer
5d
Save
Mark Applied
Hide
AI Infrastructure Engineer
Charlotte, North Carolina, United States
OnsiteFull Time
5+ YOEBachelor’s degree in computer science, engineering, information systems, or related field; 5+ years of infrastructure engineering experience; strong enterprise infrastructure technology knowledge.
3w
Save
Mark Applied
Hide
AI Infrastructure Engineer
San Francisco, California, United States
$150k-$220k/yr OnsiteFull Time
5+ YOE5+ years in systems or infrastructure engineering with GPU, HPC, or ML infrastructure experience; technical bachelor's or master's degree; Linux, Kubernetes, schedulers, configuration management, Python, Bash, containers, GPUs, and RDMA expertise.
Ansible, SaltStack, Git, Python, Bash, Kubernetes, NVIDIA GPU Operator, Slurm, Run:AI, enroot, pyxis, Docker, containerd, NVIDIA Container Toolkit, CUDA, cuDNN, NCCL, Fabric Manager, ROCm, RCCL, DKMS, GPUDirect RDMA, GPUDirect Storage, MOFED, DOCA, PyTorch, JAX, DCGM exporter, Prometheus, Grafana, PXE, MaaS, Packer, Foreman, Terraform, Lustre, GPFS, Weka, vLLM, Triton Inference Server, TensorRT-LLM, Nsight Systems, Nsight Compute, rocprof, perf, eBPF, EMR
3mo
Save
Mark Applied
Hide
AI Infrastructure Engineer
San Francisco, California, United States
$190k-$270k/yr OnsiteFull Time
5+ YOE5+ years in AI infrastructure or related roles; BS in CS or equivalent; knowledge of Ansible, Terraform, Kubernetes; programming/scripting; monitoring/observability; cloud services; collaborative work
Ansible, Terraform, Kubernetes
1mo
Save
Mark Applied
Hide
Staff AI Infrastructure Engineer
Austin or Reston
HybridFull Time
8+ YOE8+ years building distributed systems and cloud-native AI infrastructure; strong Python and systems programming skills; Kubernetes, GPU inference, and platform engineering experience; leadership and architecture experience.
Python, Go, Rust, C++, vLLM, SGLang, TensorRT-LLM, Triton Inference Server, Ray Serve, Kubernetes, Helm, Argo CD, Docker, Prometheus, Grafana, OpenTelemetry, Infrastructure-as-Code, GitOps, CI/CD, AWS, Azure, Oracle Cloud Infrastructure, Google Cloud Platform
2w
Save
Mark Applied
Hide
AI Infrastructure Engineer
Los Altos, California, United States
OnsiteFull Time
3+ YOE3+ years in a relevant technical domain, distributed systems and software engineering experience, cloud platform expertise, infrastructure automation, production debugging, and Python or another modern programming language.
Python, Docker, AWS, Azure, ECS, Lambda, API Gateway, OpenTofu, Terraform, Datadog, CI/CD
1mo
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer
United States
$150k-$180k/yr RemoteFull Time
6+ YOE6+ years software engineering with 1+ years in AI/ML infrastructure or LLM platform work; strong Go, Python, SQL; experience with multi-tenant APIs, on-call production operations, LLM APIs, and agentic systems.
Go (Golang), Python, SQL, Anthropic, OpenAI, Llama, Mistral, LoRA, PEFT, Rust, MCP, A2A
1mo
Save
Mark Applied
Hide
AI Infrastructure Engineer
Fremont, California, United States
OnsiteFull Time
Experience with on-prem/datacenter operations, Infrastructure-as-Code, networking (VLANs/routing/firewalls), container orchestration, scripting, Git; comfortable with hands-on hardware tasks.
Terraform, Terragrunt, Ansible, Vault, Boundary, Keycloak, Prometheus, Grafana, Alertmanager, Docker, Kubernetes, Git, Jira, Confluence
2mo
Save
Mark Applied
Hide
AI Infrastructure Engineer
Seattle, Washington, United States
$152k-$332k/yr OnsiteFull Time
5+ YOEBachelor's in CS/Engineering/AI, 5+ years software engineering experience in infrastructure and distributed systems, GPU/CUDA expertise, container and cloud experience, Python/C++ programming, PyTorch and Transformers experience.
Docker, Kubernetes, CUDA, Python, C++, PyTorch, Transformers, BrightHire
1w
Save
Mark Applied
Hide
AI Infrastructure & Platform Engineer
Delray Beach, Florida, United States
OnsiteFull Time
5+ YOERequires 5+ years in software, cloud infrastructure, platform engineering, MLOps, or DevOps; production application experience; cloud platform expertise; AI/LLM experience; API integration and security knowledge.
AWS, Microsoft Azure, GCP, CI/CD, APIs, Docker, Kubernetes, Terraform, Model Context Protocol (MCP), Anthropic Claude, OpenAI, Google Gemini, Hugging Face, LangChain, LangGraph, SOC 2, LLMs, RAG
3w
Save
Mark Applied
Hide
AI Infrastructure Engineer
Charlotte, North Carolina, United States
$140k-$170k/yr OnsiteFull Time
8+ YOE8+ years in LLM/MLOps and MLOps platforms; experience with Terraform, Docker, cloud (AWS), Kubernetes, CI/CD, Python/PySpark/Bash; production AI/platform deployment and security best practices.
Docker, Terraform, AWS, GitHub Actions, GitLab CI, Kubernetes, Python, PySpark, Bash
1mo
Save
Mark Applied
Hide
AI & HPC Infrastructure Engineer
St. Louis, Missouri, United States
HybridFull Time
5+ YOE5+ years designing, deploying, and managing AI/HPC infrastructure; experience with accelerated computing, cluster management, orchestration, networking, storage, and automation; bachelor’s degree or equivalent.
Slurm, Run:ai, Kubernetes, Base Command Manager (BCM), NGC, NCCL, NVLink, CUDA, TensorRT-LLM, vLLM, SGLang, Triton Inference Server, NVIDIA Dynamo, llm-d, MLPerf, fio, iperf, Python, Terraform, Ansible, AWS, Azure, GCP, VMware, Nutanix, SONiC, VAST, Weka, DDN, TensorFlow, PyTorch, JAX, Jupyter, Google Colab
4d
Save
Mark Applied
Hide
AI Infrastructure Engineer
San Francisco or New York City
$350k-$475k/yr OnsiteFull Time
4+ YOE4+ years operating large-scale distributed systems in production; expertise in Linux, networking, complex failure debugging, and Python, Go, or C++; on-call experience required.
Python, Go, C++, Linux, PyTorch, Ray, Slurm, Kubernetes, InfiniBand, RDMA, NCCL, RLHF, PPO, DPO
2mo
Save
Mark Applied
Hide
AI Infrastructure Engineer
San Jose, California, United States
$192k-$250k/yr OnsiteFull Time
5+ YOERequires 5+ years building AI inference systems, LLM/VLM internals, performance engineering, GPU/NPU programming, C/C++, systems programming, and a BS/MS in computer science, computer engineering, or a related field.
Large Language Models (LLMs), Vision-Language Models (VLMs), GPU, NPU, DSP, CUDA, PyTorch, TensorFlow, C, C++, AIOS
1mo
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer, LLM/AI Platforms
Virginia or United States
$140k-$215k/yr RemoteFull Time
6+ YOE6+ years infrastructure/data engineering experience with 2+ years on LLM platforms; bachelor’s in CS or related; hands-on LLM infra, GPU cluster provisioning, distributed training, container orchestration, IaC, EMR/cloud experience, strong Python skills, technical leadership.
MLflow, Sagemaker, Vertex AI, CUDA, NVIDIA, GPU, TPU, vLLM, Triton Inference Server, Pytorch, Ray, Megatron, JAX, Python, Docker, Kubernetes, Slurm, Airflow, Terraform, Ansible, AWS, GCP, OCI, LangChain, LlamaIndex, Spark, Dask, Flink
1mo
Save
Mark Applied
Hide
AI Infrastructure Engineer
Huntsville, Alabama, United States
OnsiteFull Time
10+ YOEBachelor's in CS/Engineering/Data Science/Math,10+ years enterprise IT experience, experience with AI/ML applications, familiarity with LLM patterns, strong communication, and active security clearance.
LangChain, LangGraph, Semantic Kernel, AutoGen, CrewAI, Haystack, LlamaIndex, Python, JavaScript, TypeScript
2mo
Save
Mark Applied
Hide
AI Infrastructure & Security Engineer
Alexandria, Virginia, United States
$110k-$140k/yr RemoteFull Time
3+ YOE3+ years software engineering and Azure experience, CI/CD and DevOps with Azure DevOps/GitHub, containerization, Python scripting, production AI coding agent experience, security-focused instincts, and ability to communicate across teams.
Claude, Claude Code, CLAUDE.md, Cowork, Azure, Azure Container Apps, Azure DevOps, Azure Repos, GitHub, CI/CD, npm, NuGet, Office 365, eCommerce, CRM, Python, Windows Server, Linux, DNS, TCP/IP, firewalls, VPNs, MCP
2mo
Save
Mark Applied
Hide
AI Infrastructure Engineer
United States
OnsiteFull Time
5+ YOE5+ years infrastructure/cloud/DevOps experience with AWS and Azure, Terraform, Docker, CI/CD, monitoring, Linux, scripting, and cloud security/IAM.
Azure, AWS, Terraform, Docker, GitHub Actions, Prometheus, Grafana, ELK, Jenkins, Azure DevOps, Linux, Vault, AWS Secrets Manager, Azure Key Vault, Python, Bash, PowerShell, Kubernetes, App Services, Load Balancers
2w
Save
Mark Applied
Hide
Senior/Staff AI Infrastructure Engineer
San Francisco, California, United States
$180k-$250k/yr OnsiteFull Time
5+ YOERequires 5+ years building production infrastructure, distributed systems, developer platforms, or execution runtimes; multi-tenant workloads; strong Linux and programming skills; Kubernetes or comparable scheduler; AWS or Azure experience.
Linux, Kubernetes, AWS, Azure, Go, Rust, TypeScript, Python, Firecracker, gVisor, Kata Containers, eBPF, E2B, Modal, Fly Machines, FUSE, Kafka, NATS, Inngest, Temporal
1mo
Save
Mark Applied
Hide
Principal AI Infrastructure & Cloud Engineer
Chattanooga or New York or New Jersey or California or Massachusetts
RemoteFull Time
8+ YOEBachelor's or equivalent, 8+ years cloud/infrastructure engineering, enterprise cloud architecture and migrations, CI/CD, automation, containerization, networking, logging/monitoring, and cloud security.
Splunk, New Relic, Logstash, CloudTrail, Azure, AWS, GCP, Docker, Kubernetes, Terraform, Ansible, GitHub, Bitbucket, Microsoft Azure DevOps, Jenkins
Explore Jobs