252 ai infrastructure engineer jobs at 171 companies in New York
2w
Save
Mark Applied
Hide
Principal AI Infrastructure & Cloud Engineer
Chattanooga or New York or New Jersey or California or Massachusetts
RemoteFull Time
8+ YOEBachelor's or equivalent, 8+ years cloud/infrastructure engineering, enterprise cloud architecture and migrations, CI/CD, automation, containerization, networking, logging/monitoring, and cloud security.
Splunk, New Relic, Logstash, CloudTrail, Azure, AWS, GCP, Docker, Kubernetes, Terraform, Ansible, GitHub, Bitbucket, Microsoft Azure DevOps, Jenkins
2mo
Save
Mark Applied
Hide
Gen AI Infrastructure Engineer
Woodbridge or New York City or Atlanta or Boston or Chicago or Dallas or Delaware or Denver or Garden City or Cayman Islands or Greenwich or Houston or Los Angeles or Miami or Naples or Nevada or Palm Beach or San Diego or San Francisco or Seattle or Stuart or Washington
$160k-$200k/yr HybridFull Time
7+ YOE7+ years in DevOps/platform/cloud infrastructure engineering; strong AWS (IAM, CloudFormation, Lambda, API Gateway, VPC, CloudWatch, SSM, Secrets Manager, ECR); AWS CDK/CloudFormation/Terraform; CI/CD (Bitbucket/GitHub Actions, OIDC); container and datastore operations; security fundamentals.
AWS Bedrock, AgentCore, Lambda, API Gateway, AWS CDK, CloudFormation, Terraform, Bitbucket Pipelines, GitHub Actions, OIDC, IAM, VPC, CloudWatch, SSM, Secrets Manager, ECR, Neo4j, Neptune, Redis, Milvus, VectorDB
1mo
Save
Mark Applied
Hide
AI-Enabled Infrastructure and Systems Engineer
New York, New York, United States
$162k-$200k/yr HybridFull Time
5+ YOE5+ years infrastructure engineering experience; cloud (AWS/Azure/GCP) and IaC (Terraform/CloudFormation/ARM/Bicep/Ansible) proficiency; scripting (Python/Java/Golang); experience supporting AI/ML workloads and platform engineering.
Terraform, Ansible, CloudFormation, ARM/Bicep, Python, Java, Golang, AWS, Microsoft Azure ML, Microsoft Azure Foundry, AWS Bedrock, Google Vertex
1mo
Save
Mark Applied
Hide
AI Engineer - Cloud Infrastructure
New York, New York, United States
$175k-$275k/yr OnsiteFull Time
7+ YOE7+ years experience operating cloud and Kubernetes-native infrastructure at scale; hands-on with AWS, EKS, Terraform, Helm; strong debugging, incident response, and capacity planning skills.
AWS, EKS, Terraform, Helm, Kubernetes, Python, Envoy, Istio, Cilium, eBPF, Rust, TypeScript, GCP, Azure, Oracle Cloud
3d
Save
Mark Applied
Hide
AI & HPC Infrastructure Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irvine or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$266k/yr HybridFull Time
5+ YOERequires 5+ years designing AI infrastructure, accelerated computing, clusters, orchestration, and automation; bachelor's degree or equivalent experience. Strong Kubernetes, Python, Terraform, and cloud expertise required.
Slurm, Run:ai, Kubernetes, NVIDIA Base Command Manager (BCM), NVIDIA NGC, NCCL, NVLink, CUDA, TensorRT-LLM, vLLM, SGLang, Triton Inference Server, NVIDIA Dynamo, llm-d, MLPerf, NCCL tests, fio, iperf, InfiniBand, Ethernet, SONiC, NVMe, NVMe-oF, VAST, Weka, DDN, AWS, Azure, GCP, VMware, Nutanix, Python, Terraform, Ansible, REST, OpenAPI, JSON, YAML, TensorFlow, PyTorch, JAX, Jupyter notebooks, Google Colab, MCP
2w
Save
Mark Applied
Hide
Infrastructure engineer
New York City or Seattle or San Francisco or London
$140k-$274k/yr HybridFull Time
5+ YOE5+ years infrastructure/DevOps experience, production Kubernetes, Helm, Terraform/Pulumi, major cloud (AWS preferred), Python or Go, observability stacks (Prometheus, Grafana, ELK), and daily AI-assisted workflows.
Python, Go, AWS, GCP, Azure, Kubernetes, Helm, Terraform, Pulumi, Claude Code, Droid, Codex, Prometheus, Grafana, ELK
2mo
Save
Mark Applied
Hide
Cloud Infrastructure and AI Efficiency Engineer
New York City, New York, United States
OnsiteFull Time
Engineering role focused on cloud infrastructure and AI efficiency to support Apple's product and service innovation.
1w
Save
Mark Applied
Hide
Lead AI Engineer
Holmdel or Bethlehem or New York City
$119k-$195k/yr HybridFull Time
Advanced knowledge of machine learning engineering, distributed systems, cloud infrastructure, AI platforms, LLMs, RAG pipelines, orchestration, agentic frameworks, secure APIs, and enterprise governance.
Large Language Models (LLMs), retrieval-augmented generation (RAG), model orchestration frameworks, Agentic frameworks, API, cloud infrastructure, AI platforms
3mo
Save
Mark Applied
Hide
Infrastructure Engineer
New York or San Francisco or United States
$165k-$200k/yr HybridFull Time
Kubernetes production experience; IaC (Terraform/Helm); cloud (AWS/GCP); Python/Node.js; CI/CD (GitHub Actions/Spacelift); security and ML/AI infrastructure familiarity.
Kubernetes, Terraform, Helm, Python, Node.js, GitHub Actions, Spacelift, AWS, GCP, PyTorch, TensorFlow, Bash
1mo
Save
Mark Applied
Hide
Staff AI Engineer
Miami or New York or San Francisco or Mexico City or United States
RemoteFull Time
8+ YOE8+ years software engineering experience with infrastructure and systems development; 2+ years building production LLM/AI applications; strong Python, system architecture, containerization (Docker/Kubernetes), CI/CD, observability, RAG and agentic systems experience.
Python, Docker, Kubernetes, CI/CD, LLM APIs, LLMOps, RAG, vector databases, Open CLAW, Hermes, WhatsApp
1w
Save
Mark Applied
Hide
Senior DevOps / Infrastructure Engineer
New York City or United States
$180k-$250k/yr HybridFull Time
5+ YOE5+ years in DevOps, SRE, or infrastructure engineering; strong Linux, systemd, networking, shell, Ansible, Terraform, observability, automation, incident response, and AI-assisted engineering experience.
Ansible, Terraform, Atlantis, Kubernetes, Flux, Prometheus, Grafana, Loki, GitOps, SSH, Python, bash, Argo, MCP servers, EVM, GitHub, LLM tooling
2w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
3mo
Save
Mark Applied
Hide
Staff Software Engineer - AI Research Infrastructure
San Francisco or New York City
$199k-$270k/yr HybridFull Time
5+ YOEBS/MS or PhD in computer science; 5+ years of software engineering experience in distributed systems or infrastructure; strong experience with GPUs, clusters, and cloud platforms; proficient in systems languages and large-scale job orchestration.
C++, Rust, Go, Java, Scala, Kubernetes, Slurm, Ray, GPU, Cloud computing, Distributed systems
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York or San Francisco or McLean or Cambridge or San Jose or Plano
$209k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE +6 years or Master's +4 years; 6+ years programming with Python/Go/Scala/Java; experience deploying scalable AI on cloud; LLM, inference, similarity search, VectorDBs, guardrails, model evaluation, and optimization experience; leadership and research literacy.
Python, Go, Scala, Java, C++, C#, Golang, AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure
1mo
Save
Mark Applied
Hide
Sr AI Engineer I
New York or Sunrise or Phoenix
$123k-$215k/yr OnsiteFull Time
5+ YOE5+ years software engineering experience with production LLM or applied ML systems; strong backend, APIs, data pipelines, and cloud infrastructure skills; experience shipping AI/agentic systems and owning production reliability.
Python, Go, TypeScript, AWS, GCP, Kubernetes, REST, gRPC, Kafka, LLMs
3w
Save
Mark Applied
Hide
AI Platform Engineer
Boston or Springfield or New York City
$164k-$215k/yr HybridFull Time
5+ YOE5+ years platform/infrastructure/SRE experience, cloud-native Kubernetes expertise, CKA/CKAD or AWS certifications, IaC/GitOps experience, AI/ML infrastructure and platform ownership from design to production.
Kubernetes, Terraform, Pulumi, ArgoCD, vLLM, Triton, Ray Serve, AWS, GCP, Azure, Degreed
2mo
Save
Mark Applied
Hide
Executive Director, AI Infrastructure & Platform Engineering
New York or Mississippi or Montana or North Carolina or Louisiana or Maryland or Maine or Minnesota or Nebraska or Missouri or North Dakota or New Jersey or New Mexico or Nevada or Ohio or South Carolina or Texas or Rhode Island or South Dakota or Vermont or Tennessee or Virginia or Washington or Utah or Wisconsin or West Virginia or Oregon or Wyoming or Oklahoma or Pennsylvania or Colorado or Alabama or Arizona or California or Connecticut or District of Columbia or Florida or Hawaii or Iowa or Alaska or Arkansas or Idaho or Illinois or Kansas or Delaware or Georgia or Indiana or Kentucky or Michigan or Massachusetts or New Hampshire
$175k-$335k/yr RemoteFull Time
10+ YOE5+ Mgmt10+ years engineering leadership with data center-scale infrastructure experience; hands-on bare-metal Kubernetes/OpenShift; experience with high-speed fabrics and GPU clusters; Bachelor's required.
Kubernetes, OpenShift, EKS, GKE, AKS, RoCE v2, InfiniBand, EVPN-VXLAN, Cisco UCS, NVIDIA HGX, NVIDIA DGX, NVIDIA Blackwell, VAST, NVMe, NVIDIA AI Enterprise, NVIDIA Run:AI, NVIDIA Base Command Manager, HIPAA, NIST AI RMF
3w
Save
Mark Applied
Hide
Director of AI Platforms and Infrastructure
Atlanta or Sandy Springs or New York City or Chicago or Houston or Dallas or United States
RemoteFull Time
5+ YOE5+ years in enterprise infrastructure, cloud, SaaS or AI platform operations; experience with governance, IAM, licensing, cost management, client enablement, and APIs/integrations.
ChatGPT Enterprise, Claude Enterprise, APIs
1mo
Save
Mark Applied
Hide
Principal AI Platform Engineer
United States or Minneapolis or New York City
$118k-$207k/yr RemoteFull Time
Senior engineer to build and operate AI-driven cloud platforms using Kubernetes, Docker, Postgres, and infrastructure-as-code; must secure systems, review code, and participate in 24/7 on-call rotation.
Postgres, Kubernetes, Docker, Argo, GitHub, Entra, Intune, Azure, AWS, GCP, Prometheus, Grafana, Instana, Terraform, Bicep, Ansible, Sentinel, JIRA, Confluence, JAMF, Ubuntu, Linux, Windows, Mac, IaaS, PaaS
2mo
Save
Mark Applied
Hide
Staff Engineer, AI Productivity
North America or New York or San Francisco
$180k-$400k/yr RemoteFull Time
Strong software engineering fundamentals; hands-on experience with AI coding agents; experience writing agent documentation; building developer tools and integrations; comfortable with CI/CD, cloud infrastructure, and full-stack code.
Claude Code, Cursor, Copilot, Devin, CircleCI, Slack, Datadog, GitHub, TypeScript, JavaScript, Go, GraphQL, MCP
Explore Jobs
Expand Your Job Search
Top Cities in New York for AI Infrastructure Engineer
- AI Infrastructure Engineer jobs in New York, NY
- AI Infrastructure Engineer jobs in Brooklyn, NY
- AI Infrastructure Engineer jobs in Queens, NY
- AI Infrastructure Engineer jobs in Manhattan, NY
- AI Infrastructure Engineer jobs in The Bronx, NY
- AI Infrastructure Engineer jobs in Staten Island, NY
- AI Infrastructure Engineer jobs in Buffalo, NY
- AI Infrastructure Engineer jobs in Rochester, NY
- AI Infrastructure Engineer jobs in Yonkers, NY
- AI Infrastructure Engineer jobs in Syracuse, NY
- AI Infrastructure Engineer jobs in Amherst, NY
- AI Infrastructure Engineer jobs in Albany, NY
- AI Infrastructure Engineer jobs in Greenburgh, NY
- AI Infrastructure Engineer jobs in New Rochelle, NY
- AI Infrastructure Engineer jobs in Cheektowaga, NY
- AI Infrastructure Engineer jobs in Mount Vernon, NY
- AI Infrastructure Engineer jobs in Schenectady, NY
- AI Infrastructure Engineer jobs in Utica, NY
- AI Infrastructure Engineer jobs in White Plains, NY
- AI Infrastructure Engineer jobs in Clay, NY