299 ai infrastructure engineer jobs at 186 companies in Manhattan, NY
4w
Save
Mark Applied
Hide
Lead Infrastructure Engineer – Infrastructure (IBM Power/AIX) with AI/Automation
Jersey City, New Jersey, United States
$143k-$185k/yr OnsiteFull Time
5+ YOE5+ years infrastructure engineering experience with IBM Power/AIX, PowerVM/VIOS, HMC, GPFS; Unix shell scripting, Python and Ansible; experience using enterprise AI for infrastructure automation and validation.
IBM Power, AIX, PowerVM, VIOS, HMC, GPFS, Unix shell scripting, Python, Ansible
2mo
Save
Mark Applied
Hide
Gen AI Infrastructure Engineer
Woodbridge or New York City or Atlanta or Boston or Chicago or Dallas or Delaware or Denver or Garden City or Cayman Islands or Greenwich or Houston or Los Angeles or Miami or Naples or Nevada or Palm Beach or San Diego or San Francisco or Seattle or Stuart or Washington
$160k-$200k/yr HybridFull Time
7+ YOE7+ years in DevOps/platform/cloud infrastructure engineering; strong AWS (IAM, CloudFormation, Lambda, API Gateway, VPC, CloudWatch, SSM, Secrets Manager, ECR); AWS CDK/CloudFormation/Terraform; CI/CD (Bitbucket/GitHub Actions, OIDC); container and datastore operations; security fundamentals.
AWS Bedrock, AgentCore, Lambda, API Gateway, AWS CDK, CloudFormation, Terraform, Bitbucket Pipelines, GitHub Actions, OIDC, IAM, VPC, CloudWatch, SSM, Secrets Manager, ECR, Neo4j, Neptune, Redis, Milvus, VectorDB
1mo
Save
Mark Applied
Hide
AI-Enabled Infrastructure and Systems Engineer
New York, New York, United States
$162k-$200k/yr HybridFull Time
5+ YOE5+ years infrastructure engineering experience; cloud (AWS/Azure/GCP) and IaC (Terraform/CloudFormation/ARM/Bicep/Ansible) proficiency; scripting (Python/Java/Golang); experience supporting AI/ML workloads and platform engineering.
Terraform, Ansible, CloudFormation, ARM/Bicep, Python, Java, Golang, AWS, Microsoft Azure ML, Microsoft Azure Foundry, AWS Bedrock, Google Vertex
1mo
Save
Mark Applied
Hide
AI Infrastructure Engineer, Sandbox Platform
San Francisco or Seattle or New York City
$180k-$225k/yr OnsiteFull Time
4+ YOE4+ years building high-performance systems software; deep Linux internals, containerization/virtualization, systems programming (Go/Rust/C/C++); strong debugging and API/SDK design skills.
Docker, Firecracker, gVisor, QEMU, Kata Containers, Go, Rust, C/C++, Kubernetes, OpenHands, Agent2Agent, MCP, CRIU
1mo
Save
Mark Applied
Hide
AI Engineer - Cloud Infrastructure
New York, New York, United States
$175k-$275k/yr OnsiteFull Time
7+ YOE7+ years experience operating cloud and Kubernetes-native infrastructure at scale; hands-on with AWS, EKS, Terraform, Helm; strong debugging, incident response, and capacity planning skills.
AWS, EKS, Terraform, Helm, Kubernetes, Python, Envoy, Istio, Cilium, eBPF, Rust, TypeScript, GCP, Azure, Oracle Cloud
6d
Save
Mark Applied
Hide
AI & HPC Infrastructure Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irvine or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$266k/yr HybridFull Time
5+ YOERequires 5+ years designing AI infrastructure, accelerated computing, clusters, orchestration, and automation; bachelor's degree or equivalent experience. Strong Kubernetes, Python, Terraform, and cloud expertise required.
Slurm, Run:ai, Kubernetes, NVIDIA Base Command Manager (BCM), NVIDIA NGC, NCCL, NVLink, CUDA, TensorRT-LLM, vLLM, SGLang, Triton Inference Server, NVIDIA Dynamo, llm-d, MLPerf, NCCL tests, fio, iperf, InfiniBand, Ethernet, SONiC, NVMe, NVMe-oF, VAST, Weka, DDN, AWS, Azure, GCP, VMware, Nutanix, Python, Terraform, Ansible, REST, OpenAPI, JSON, YAML, TensorFlow, PyTorch, JAX, Jupyter notebooks, Google Colab, MCP
3w
Save
Mark Applied
Hide
Infrastructure engineer
New York City or Seattle or San Francisco or London
$140k-$274k/yr HybridFull Time
5+ YOE5+ years infrastructure/DevOps experience, production Kubernetes, Helm, Terraform/Pulumi, major cloud (AWS preferred), Python or Go, observability stacks (Prometheus, Grafana, ELK), and daily AI-assisted workflows.
Python, Go, AWS, GCP, Azure, Kubernetes, Helm, Terraform, Pulumi, Claude Code, Droid, Codex, Prometheus, Grafana, ELK
2mo
Save
Mark Applied
Hide
Cloud Infrastructure and AI Efficiency Engineer
New York City, New York, United States
OnsiteFull Time
Engineering role focused on cloud infrastructure and AI efficiency to support Apple's product and service innovation.
2w
Save
Mark Applied
Hide
Lead AI Engineer
Holmdel or Bethlehem or New York City
$119k-$195k/yr HybridFull Time
Advanced knowledge of machine learning engineering, distributed systems, cloud infrastructure, AI platforms, LLMs, RAG pipelines, orchestration, agentic frameworks, secure APIs, and enterprise governance.
Large Language Models (LLMs), retrieval-augmented generation (RAG), model orchestration frameworks, Agentic frameworks, API, cloud infrastructure, AI platforms
1d
Save
Mark Applied
Hide
Staff Infrastructure Engineer
United States or San Francisco or New York City or Chicago
$187k-$235k/yr RemoteFull Time
8+ YOERequires 8+ years in infrastructure, cloud, or platform engineering; deep AWS experience; Terraform and Kubernetes ownership; AI-assisted engineering fluency; and security/compliance experience in regulated environments.
Amazon Web Services (AWS), Kubernetes, Terraform, ArgoCD, GitHub Actions, Claude, OpenAI Codex, Cursor, GitHub Copilot, AWS Bedrock, Okta, OpenID Connect (OIDC), Security Assertion Markup Language (SAML), Envoy, Python, Go, Bash, Snowflake, IAM, RBAC
3mo
Save
Mark Applied
Hide
Infrastructure Engineer
New York or San Francisco or United States
$165k-$200k/yr HybridFull Time
Kubernetes production experience; IaC (Terraform/Helm); cloud (AWS/GCP); Python/Node.js; CI/CD (GitHub Actions/Spacelift); security and ML/AI infrastructure familiarity.
Kubernetes, Terraform, Helm, Python, Node.js, GitHub Actions, Spacelift, AWS, GCP, PyTorch, TensorFlow, Bash
2w
Save
Mark Applied
Hide
Senior DevOps / Infrastructure Engineer
New York City or United States
$180k-$250k/yr HybridFull Time
5+ YOE5+ years in DevOps, SRE, or infrastructure engineering; strong Linux, systemd, networking, shell, Ansible, Terraform, observability, automation, incident response, and AI-assisted engineering experience.
Ansible, Terraform, Atlantis, Kubernetes, Flux, Prometheus, Grafana, Loki, GitOps, SSH, Python, bash, Argo, MCP servers, EVM, GitHub, LLM tooling
3w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
3mo
Save
Mark Applied
Hide
Staff Software Engineer - AI Research Infrastructure
San Francisco or New York City
$199k-$270k/yr HybridFull Time
5+ YOEBS/MS or PhD in computer science; 5+ years of software engineering experience in distributed systems or infrastructure; strong experience with GPUs, clusters, and cloud platforms; proficient in systems languages and large-scale job orchestration.
C++, Rust, Go, Java, Scala, Kubernetes, Slurm, Ray, GPU, Cloud computing, Distributed systems
2mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York or San Francisco or McLean or Cambridge or San Jose or Plano
$209k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE +6 years or Master's +4 years; 6+ years programming with Python/Go/Scala/Java; experience deploying scalable AI on cloud; LLM, inference, similarity search, VectorDBs, guardrails, model evaluation, and optimization experience; leadership and research literacy.
Python, Go, Scala, Java, C++, C#, Golang, AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure
1mo
Save
Mark Applied
Hide
Sr AI Engineer I
New York or Sunrise or Phoenix
$123k-$215k/yr OnsiteFull Time
5+ YOE5+ years software engineering experience with production LLM or applied ML systems; strong backend, APIs, data pipelines, and cloud infrastructure skills; experience shipping AI/agentic systems and owning production reliability.
Python, Go, TypeScript, AWS, GCP, Kubernetes, REST, gRPC, Kafka, LLMs
4w
Save
Mark Applied
Hide
AI Platform Engineer
Boston or Springfield or New York City
$164k-$215k/yr HybridFull Time
5+ YOE5+ years platform/infrastructure/SRE experience, cloud-native Kubernetes expertise, CKA/CKAD or AWS certifications, IaC/GitOps experience, AI/ML infrastructure and platform ownership from design to production.
Kubernetes, Terraform, Pulumi, ArgoCD, vLLM, Triton, Ray Serve, AWS, GCP, Azure, Degreed
3mo
Save
Mark Applied
Hide
Engineer II, IT Infrastructure
Fort Lee, New Jersey, United States
$80k-$110k/yr HybridAll Commitments Available
3+ YOE3+ years IT infrastructure, cloud engineering, or systems engineering; Terraform; AWS; Windows and Linux; networking; automation; monitoring; security and compliance.
Terraform, CloudFormation, AWS, Windows, Linux, GitHub Copilot, Cursor, AI development tools
1mo
Save
Mark Applied
Hide
Director of AI Platforms and Infrastructure
Atlanta or Sandy Springs or New York City or Chicago or Houston or Dallas or United States
RemoteFull Time
5+ YOE5+ years in enterprise infrastructure, cloud, SaaS or AI platform operations; experience with governance, IAM, licensing, cost management, client enablement, and APIs/integrations.
ChatGPT Enterprise, Claude Enterprise, APIs
1mo
Save
Mark Applied
Hide
Principal AI Platform Engineer
United States or Minneapolis or New York City
$118k-$207k/yr RemoteFull Time
Senior engineer to build and operate AI-driven cloud platforms using Kubernetes, Docker, Postgres, and infrastructure-as-code; must secure systems, review code, and participate in 24/7 on-call rotation.
Postgres, Kubernetes, Docker, Argo, GitHub, Entra, Intune, Azure, AWS, GCP, Prometheus, Grafana, Instana, Terraform, Bicep, Ansible, Sentinel, JIRA, Confluence, JAMF, Ubuntu, Linux, Windows, Mac, IaaS, PaaS
Explore Jobs
Expand Your Job Search
Top Cities Near Manhattan for AI Infrastructure Engineer
- AI Infrastructure Engineer jobs in New York, NY
- AI Infrastructure Engineer jobs in Brooklyn, NY
- AI Infrastructure Engineer jobs in Queens, NY
- AI Infrastructure Engineer jobs in The Bronx, NY
- AI Infrastructure Engineer jobs in Staten Island, NY
- AI Infrastructure Engineer jobs in Newark, NJ
- AI Infrastructure Engineer jobs in Jersey City, NJ
- AI Infrastructure Engineer jobs in Yonkers, NY
- AI Infrastructure Engineer jobs in Paterson, NJ
- AI Infrastructure Engineer jobs in Bridgeport, CT
- AI Infrastructure Engineer jobs in Elizabeth, NJ
- AI Infrastructure Engineer jobs in Stamford, CT
- AI Infrastructure Engineer jobs in Edison, NJ
- AI Infrastructure Engineer jobs in Norwalk, CT
- AI Infrastructure Engineer jobs in Greenburgh, NY
- AI Infrastructure Engineer jobs in Clifton, NJ
- AI Infrastructure Engineer jobs in Danbury, CT
- AI Infrastructure Engineer jobs in New Rochelle, NY
- AI Infrastructure Engineer jobs in Passaic, NJ
- AI Infrastructure Engineer jobs in Union City, NJ