97 ai infrastructure engineer jobs at 64 companies in Ashburn, IL
2mo
Save
Mark Applied
Hide
Gen AI Infrastructure Engineer
Woodbridge or New York City or Atlanta or Boston or Chicago or Dallas or Delaware or Denver or Garden City or Cayman Islands or Greenwich or Houston or Los Angeles or Miami or Naples or Nevada or Palm Beach or San Diego or San Francisco or Seattle or Stuart or Washington
$160k-$200k/yr HybridFull Time
7+ YOE7+ years in DevOps/platform/cloud infrastructure engineering; strong AWS (IAM, CloudFormation, Lambda, API Gateway, VPC, CloudWatch, SSM, Secrets Manager, ECR); AWS CDK/CloudFormation/Terraform; CI/CD (Bitbucket/GitHub Actions, OIDC); container and datastore operations; security fundamentals.
AWS Bedrock, AgentCore, Lambda, API Gateway, AWS CDK, CloudFormation, Terraform, Bitbucket Pipelines, GitHub Actions, OIDC, IAM, VPC, CloudWatch, SSM, Secrets Manager, ECR, Neo4j, Neptune, Redis, Milvus, VectorDB
2w
Save
Mark Applied
Hide
AI & HPC Infrastructure Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irvine or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$266k/yr HybridFull Time
5+ YOERequires 5+ years designing AI infrastructure, accelerated computing, clusters, orchestration, and automation; bachelor's degree or equivalent experience. Strong Kubernetes, Python, Terraform, and cloud expertise required.
Slurm, Run:ai, Kubernetes, NVIDIA Base Command Manager (BCM), NVIDIA NGC, NCCL, NVLink, CUDA, TensorRT-LLM, vLLM, SGLang, Triton Inference Server, NVIDIA Dynamo, llm-d, MLPerf, NCCL tests, fio, iperf, InfiniBand, Ethernet, SONiC, NVMe, NVMe-oF, VAST, Weka, DDN, AWS, Azure, GCP, VMware, Nutanix, Python, Terraform, Ansible, REST, OpenAPI, JSON, YAML, TensorFlow, PyTorch, JAX, Jupyter notebooks, Google Colab, MCP
3w
Save
Mark Applied
Hide
Senior AI Infrastructure Architect
Chicago or United States
$175k-$245k/yr RemoteFull Time
6+ YOE6+ years building and operating production cloud/platform infrastructure with AWS, infrastructure as code, automation, scripting, and practical use of AI tools; strong networking, IAM, secrets, telemetry, and service integration skills.
Amazon Bedrock, AWS, Temporal, MCP
1w
Save
Mark Applied
Hide
Staff Infrastructure Engineer
United States or San Francisco or New York City or Chicago
$187k-$235k/yr RemoteFull Time
8+ YOERequires 8+ years in infrastructure, cloud, or platform engineering; deep AWS experience; Terraform and Kubernetes ownership; AI-assisted engineering fluency; and security/compliance experience in regulated environments.
Amazon Web Services (AWS), Kubernetes, Terraform, ArgoCD, GitHub Actions, Claude, OpenAI Codex, Cursor, GitHub Copilot, AWS Bedrock, Okta, OpenID Connect (OIDC), Security Assertion Markup Language (SAML), Envoy, Python, Go, Bash, Snowflake, IAM, RBAC
2mo
Save
Mark Applied
Hide
Senior AI Engineer
Chicago, Illinois, United States
$148k-$204k/yr RemoteFull Time
5+ YOE5+ years in software/platform/infrastructure engineering; experience building internal platforms, cloud deployments, observability, integrations, and AI agent/LLM workflows; strong system design and cross-functional communication.
LinkedIn Learning, Calm
1mo
Save
Mark Applied
Hide
Director of AI Platforms and Infrastructure
Atlanta or Sandy Springs or New York City or Chicago or Houston or Dallas or United States
RemoteFull Time
5+ YOE5+ years in enterprise infrastructure, cloud, SaaS or AI platform operations; experience with governance, IAM, licensing, cost management, client enablement, and APIs/integrations.
ChatGPT Enterprise, Claude Enterprise, APIs
1mo
Save
Mark Applied
Hide
Principal AI Engineer
Charlotte or Chicago or Columbus or Hartford
$168k-$253k/yr HybridFull Time
10+ YOEBachelor's degree in a technical field; 10+ years with cloud and software/platform infrastructure; Python and TypeScript; distributed systems, AI platforms, MLOps, RAG, vector search, and enterprise engineering.
Amazon Web Services (AWS), Google Cloud, Microsoft Azure, Python, TypeScript, CI/CD, Agile, LangGraph, crewai, NoSQL, ETL, RAG, ANN, KNN
1w
Save
Mark Applied
Hide
AI Engineer- Manager- Commercial Technology & Innovation
New York City or Tampa or Atlanta or Chicago or Washington
$99k-$232k/yr OnsiteFull Time
5+ YOEBachelor's degree and 5+ years of experience required. Proficiency in AI implementation, Python, C++, machine learning libraries, data integration, infrastructure, neural networks, and reinforcement learning.
Python, C++, TensorFlow, Scikit-Learn, AWS, Google Cloud, Microsoft Azure, Databricks, Snowflake
2w
Save
Mark Applied
Hide
Staff AI Platform Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York or Seattle or Toronto or Santa Barbara or San Diego
$180k-$273k/yr RemoteFull Time
7+ YOERequires 7+ years in AI/ML platform engineering, strong Python and/or TypeScript, distributed systems, APIs, evaluation, observability, and AI infrastructure experience; bachelor's degree or equivalent practical experience.
Python, TypeScript, JavaScript, React, Kubernetes, Docker, Terraform, LangChain, LangGraph, LlamaIndex, LiveKit, REST, gRPC, MCP, A2A
2mo
Save
Mark Applied
Hide
AI & Machine Learning Engineer
Northbrook, Illinois, United States
OnsiteFull Time
4+ YOE4+ years ML engineering experience building and deploying production models; proficiency with PyTorch or TensorFlow, Python and C++; computer vision and edge deployment experience; familiarity with ML infrastructure and CI/CD.
PyTorch, TensorFlow, TensorRT, ONNX, MLflow, Weights & Biases, ROS2, ROS, Python, C++, Linux, Docker, Git, MuJoCo, IsaacSIM, CUDA, cuDNN, NVIDIA Jetson
1mo
Save
Mark Applied
Hide
Senior AI Engineer
Chicago or Hong Kong or London or New York City or Singapore
$200k-$300k/yr OnsiteFull Time
5+ YOE5+ years software engineering with strong Python; production fine-tuning/distillation of open-weight models; on-prem LLM serving, GPU infrastructure and Kubernetes experience; model evaluation and tooling.
Python, Llama, Qwen, Mistral, vLLM, TGI, Triton, Kubernetes, Hugging Face
2d
Save
Mark Applied
Hide
Forward Deployed Engineer (Generative AI)
Chicago or United States or Canada or United Kingdom or India or Singapore or Australia
RemoteFull Time
Experienced engineer with Generative AI, Vertex AI, agentic systems, BigQuery, SQL, Python, ML engineering, cloud infrastructure, and real-time data pipeline expertise.
Vertex AI Agent Builder, Agent Developer Kit (ADK), MCP (Model Context Protocol) Toolbox, BigQuery, Spanner, Vertex AI, Dataflow, RunInference API, AlloyDB, Model Garden, Vertex AI Pipelines, SQL, Python, Google Cloud Storage, AWS, Azure, GCP
1w
Save
Mark Applied
Hide
Senior Data Engineer - AI & Analytics Infrastructure
United States or Los Angeles or Dallas or Austin or Chicago or New York City
$144k-$268k/yr HybridFull Time
7+ YOEBachelor's degree and 7+ years designing, developing, and deploying scalable AI applications and data infrastructure. Experience with LLMs, RAG, agentic workflows, pipelines, governance, APIs, and cloud-native deployment.
Microsoft Fabric, Databricks, Azure Synapse Analytics, LangChain, LangGraph, AutoGen, Semantic Kernel, CrewAI, Azure AI Search, Pinecone, Weaviate, CI/CD, LLMOps, MLOps, LLMs, RAG, MCP
4w
Save
Mark Applied
Hide
Director of Infrastructure Engineering
United States or Canada or San Francisco or New York City or Seattle or Boston or Chicago or Denver or Austin or Portland
$195k-$358k/yr RemoteFull Time
10+ YOE5+ Mgmt10+ years software engineering,5+ years engineering management,deep infrastructure and platform expertise,experience with AWS,Kubernetes,Postgres,Terraform,AI-native development,and hiring and mentoring engineers.
AWS, Postgres, Kubernetes, Redshift, Terraform, Cloudwatch, TypeScript, React, Node.js, GraphQL, PostgreSQL
2mo
Save
Mark Applied
Hide
Senior IT Engineer (AI)
Atlanta or Austin or Boston or Chicago or Denver or San Francisco or New York or London or Lisbon or United States or United Kingdom
RemoteFull Time
Experience building integrations and automations, API and cloud proficiency (GCP), AI implementation experience, strong technical communication, and operational infrastructure skills (Terraform, DNS, certificate management).
Salesforce, Snowflake, ADP, Gemini Enterprise, GCP, Terraform, Model Context Protocol (MCP)
1mo
Save
Mark Applied
Hide
AI Specialist
Chicago or New York City
$125k-$150k/yr HybridFull Time
5+ YOE5+ years in SRE, cybersecurity, cloud infrastructure, or software engineering; production AI deployment experience; expertise with frontier models, MCP/RAG/vector stores, and financial compliance; strong communication skills.
Anthropic Claude, Anthropic API, Google Gemini, Google AI Studio, OpenAI, AWS Bedrock, GCP Vertex AI, Azure OpenAI, Model Context Protocol (MCP), Retrieval-Augmented Generation (RAG), vector stores
2mo
Save
Mark Applied
Hide
Engineering Manager, Platform and AI Infrastructure
San Francisco or New York City or Salt Lake City or Atlanta or Chicago or United States
$200k-$280k/yr HybridFull Time
3+ Mgmt3+ years managing engineering teams, strong software engineering background, experience building AI infrastructure and shared platform services, hands-on coding ability, and ability to set product and technical strategy.
TypeScript, React
3w
Save
Mark Applied
Hide
Sales Engineer Data Center & AI Infrastructure
Hillsboro or Virginia or Dallas or Phoenix or Atlanta or Columbus or Chicago or Portland or Salt Lake City
RemoteFull Time
5+ YOE5+ years in data center infrastructure with 2+ years customer-facing presales; estimating, technical writing, travel 30–40%, valid driver's license, ability to obtain site access clearances.
OpusWorks, Batfish, gNMI, iPerf, nccl-tests, NVIDIA UFM, ibdiagnet, SolarWinds, Jira, Arista, Cisco, Juniper, NVIDIA/Mellanox, EVPN, VXLAN, BGP, ECMP, LLDP, CDP
2mo
Save
Mark Applied
Hide
AI DevOps Engineer-must be authorized to work in the US without any sponsorship
Mokena, Illinois, United States
$108k-$148k/yr OnsiteFull Time
5+ YOEBS/BA required, 5+ years in DevOps/Cloud/Infrastructure engineering, expertise with Kubernetes, Docker, Terraform, Azure, AI/ML infrastructure experience, strong security and API knowledge.
Kubernetes, Docker, Terraform, Azure, Azure ML Studio, Mflow, CI/CD, ERP, MES
1w
Save
Mark Applied
Hide
Manager, AI Platform Engineering
Chicago, Illinois, United States
HybridFull Time
7+ YOE2+ MgmtRequires 7+ years of software engineering experience including full-stack development and AI/ML platform infrastructure, 2+ years managing engineers, cloud infrastructure expertise, and production AI systems experience.
AI/ML, APIs, LLM, GenAI
Explore Jobs