216 ai infrastructure engineer jobs at 144 companies in Hackensack, NJ
2w
Save
Mark Applied
Hide
Lead Infrastructure Engineer – Infrastructure (IBM Power/AIX) with AI/Automation
Jersey City, New Jersey, United States
$143k-$185k/yr OnsiteFull Time
5+ YOE5+ years infrastructure engineering experience with IBM Power/AIX, PowerVM/VIOS, HMC, GPFS; Unix shell scripting, Python and Ansible; experience using enterprise AI for infrastructure automation and validation.
IBM Power, AIX, PowerVM, VIOS, HMC, GPFS, Unix shell scripting, Python, Ansible
1mo
Save
Mark Applied
Hide
Gen AI Infrastructure Engineer
Woodbridge or New York City or Atlanta or Boston or Chicago or Dallas or Delaware or Denver or Garden City or Cayman Islands or Greenwich or Houston or Los Angeles or Miami or Naples or Nevada or Palm Beach or San Diego or San Francisco or Seattle or Stuart or Washington
$160k-$200k/yr HybridFull Time
7+ YOE7+ years in DevOps/platform/cloud infrastructure engineering; strong AWS (IAM, CloudFormation, Lambda, API Gateway, VPC, CloudWatch, SSM, Secrets Manager, ECR); AWS CDK/CloudFormation/Terraform; CI/CD (Bitbucket/GitHub Actions, OIDC); container and datastore operations; security fundamentals.
AWS Bedrock, AgentCore, Lambda, API Gateway, AWS CDK, CloudFormation, Terraform, Bitbucket Pipelines, GitHub Actions, OIDC, IAM, VPC, CloudWatch, SSM, Secrets Manager, ECR, Neo4j, Neptune, Redis, Milvus, VectorDB
1mo
Save
Mark Applied
Hide
AI Infrastructure Manager
Bengaluru or San Francisco or Boston or New York City or Austin or Tokyo or London
HybridFull Time
Experience leading engineering teams building GenAI or AI infrastructure and distributed systems; strong cloud, accelerator, and performance optimization knowledge; proficiency in Python or Go; architecture and reliability experience.
Python, Go
4w
Save
Mark Applied
Hide
AI-Enabled Infrastructure and Systems Engineer
New York, New York, United States
$162k-$200k/yr HybridFull Time
5+ YOE5+ years infrastructure engineering experience; cloud (AWS/Azure/GCP) and IaC (Terraform/CloudFormation/ARM/Bicep/Ansible) proficiency; scripting (Python/Java/Golang); experience supporting AI/ML workloads and platform engineering.
Terraform, Ansible, CloudFormation, ARM/Bicep, Python, Java, Golang, AWS, Microsoft Azure ML, Microsoft Azure Foundry, AWS Bedrock, Google Vertex
2w
Save
Mark Applied
Hide
AI Infrastructure Engineer, Sandbox Platform
San Francisco or Seattle or New York City
$180k-$225k/yr OnsiteFull Time
4+ YOE4+ years building high-performance systems software; deep Linux internals, containerization/virtualization, systems programming (Go/Rust/C/C++); strong debugging and API/SDK design skills.
Docker, Firecracker, gVisor, QEMU, Kata Containers, Go, Rust, C/C++, Kubernetes, OpenHands, Agent2Agent, MCP, CRIU
1mo
Save
Mark Applied
Hide
AI Engineer - Cloud Infrastructure
New York, New York, United States
$175k-$275k/yr OnsiteFull Time
7+ YOE7+ years experience operating cloud and Kubernetes-native infrastructure at scale; hands-on with AWS, EKS, Terraform, Helm; strong debugging, incident response, and capacity planning skills.
AWS, EKS, Terraform, Helm, Kubernetes, Python, Envoy, Istio, Cilium, eBPF, Rust, TypeScript, GCP, Azure, Oracle Cloud
6d
Save
Mark Applied
Hide
Infrastructure engineer
New York City or Seattle or San Francisco or London
$140k-$274k/yr HybridFull Time
5+ YOE5+ years infrastructure/DevOps experience, production Kubernetes, Helm, Terraform/Pulumi, major cloud (AWS preferred), Python or Go, observability stacks (Prometheus, Grafana, ELK), and daily AI-assisted workflows.
Python, Go, AWS, GCP, Azure, Kubernetes, Helm, Terraform, Pulumi, Claude Code, Droid, Codex, Prometheus, Grafana, ELK
1mo
Save
Mark Applied
Hide
Cloud Infrastructure and AI Efficiency Engineer
New York City, New York, United States
OnsiteFull Time
Engineering role focused on cloud infrastructure and AI efficiency to support Apple's product and service innovation.
23h
Save
Mark Applied
Hide
Lead AI Engineer
Holmdel or Bethlehem or New York City
$119k-$195k/yr HybridFull Time
Advanced knowledge of machine learning engineering, distributed systems, cloud infrastructure, AI platforms, LLMs, RAG pipelines, orchestration, agentic frameworks, secure APIs, and enterprise governance.
Large Language Models (LLMs), retrieval-augmented generation (RAG), model orchestration frameworks, Agentic frameworks, API, cloud infrastructure, AI platforms
2mo
Save
Mark Applied
Hide
Infrastructure Engineer
New York or San Francisco or United States
$165k-$200k/yr HybridFull Time
Kubernetes production experience; IaC (Terraform/Helm); cloud (AWS/GCP); Python/Node.js; CI/CD (GitHub Actions/Spacelift); security and ML/AI infrastructure familiarity.
Kubernetes, Terraform, Helm, Python, Node.js, GitHub Actions, Spacelift, AWS, GCP, PyTorch, TensorFlow, Bash
1mo
Save
Mark Applied
Hide
Staff AI Engineer
Miami or New York or San Francisco or Mexico City or United States
RemoteFull Time
8+ YOE8+ years software engineering experience with infrastructure and systems development; 2+ years building production LLM/AI applications; strong Python, system architecture, containerization (Docker/Kubernetes), CI/CD, observability, RAG and agentic systems experience.
Python, Docker, Kubernetes, CI/CD, LLM APIs, LLMOps, RAG, vector databases, Open CLAW, Hermes, WhatsApp
2mo
Save
Mark Applied
Hide
Staff Software Engineer - AI Research Infrastructure
San Francisco or New York City
$199k-$270k/yr HybridFull Time
5+ YOEBS/MS or PhD in computer science; 5+ years of software engineering experience in distributed systems or infrastructure; strong experience with GPUs, clusters, and cloud platforms; proficient in systems languages and large-scale job orchestration.
C++, Rust, Go, Java, Scala, Kubernetes, Slurm, Ray, GPU, Cloud computing, Distributed systems
2w
Save
Mark Applied
Hide
Sr AI Engineer I
New York or Sunrise or Phoenix
$123k-$215k/yr OnsiteFull Time
5+ YOE5+ years software engineering experience with production LLM or applied ML systems; strong backend, APIs, data pipelines, and cloud infrastructure skills; experience shipping AI/agentic systems and owning production reliability.
Python, Go, TypeScript, AWS, GCP, Kubernetes, REST, gRPC, Kafka, LLMs
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York or San Francisco or McLean or Cambridge or San Jose or Plano
$209k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE +6 years or Master's +4 years; 6+ years programming with Python/Go/Scala/Java; experience deploying scalable AI on cloud; LLM, inference, similarity search, VectorDBs, guardrails, model evaluation, and optimization experience; leadership and research literacy.
Python, Go, Scala, Java, C++, C#, Golang, AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure
1w
Save
Mark Applied
Hide
AI Platform Engineer
Boston or Springfield or New York City
$164k-$215k/yr HybridFull Time
5+ YOE5+ years platform/infrastructure/SRE experience, cloud-native Kubernetes expertise, CKA/CKAD or AWS certifications, IaC/GitOps experience, AI/ML infrastructure and platform ownership from design to production.
Kubernetes, Terraform, Pulumi, ArgoCD, vLLM, Triton, Ray Serve, AWS, GCP, Azure, Degreed
2mo
Save
Mark Applied
Hide
Engineer II, IT Infrastructure
Fort Lee, New Jersey, United States
$80k-$110k/yr HybridAll Commitments Available
3+ YOE3+ years IT infrastructure, cloud engineering, or systems engineering; Terraform; AWS; Windows and Linux; networking; automation; monitoring; security and compliance.
Terraform, CloudFormation, AWS, Windows, Linux, GitHub Copilot, Cursor, AI development tools
1mo
Save
Mark Applied
Hide
Principal AI Platform Engineer
United States or Minneapolis or New York City
$118k-$207k/yr RemoteFull Time
Senior engineer to build and operate AI-driven cloud platforms using Kubernetes, Docker, Postgres, and infrastructure-as-code; must secure systems, review code, and participate in 24/7 on-call rotation.
Postgres, Kubernetes, Docker, Argo, GitHub, Entra, Intune, Azure, AWS, GCP, Prometheus, Grafana, Instana, Terraform, Bicep, Ansible, Sentinel, JIRA, Confluence, JAMF, Ubuntu, Linux, Windows, Mac, IaaS, PaaS
1mo
Save
Mark Applied
Hide
Staff Engineer, AI Productivity
North America or New York or San Francisco
$180k-$400k/yr RemoteFull Time
Strong software engineering fundamentals; hands-on experience with AI coding agents; experience writing agent documentation; building developer tools and integrations; comfortable with CI/CD, cloud infrastructure, and full-stack code.
Claude Code, Cursor, Copilot, Devin, CircleCI, Slack, Datadog, GitHub, TypeScript, JavaScript, Go, GraphQL, MCP
2w
Save
Mark Applied
Hide
Director of AI Platforms and Infrastructure
Atlanta or Sandy Springs or New York City or Chicago or Houston or Dallas or United States
RemoteFull Time
5+ YOE5+ years in enterprise infrastructure, cloud, SaaS or AI platform operations; experience with governance, IAM, licensing, cost management, client enablement, and APIs/integrations.
ChatGPT Enterprise, Claude Enterprise, APIs
2mo
Save
Mark Applied
Hide
Software Engineer, AI/ML (Infrastructure & Platform)
New York City or Tempe or San Francisco
$200k-$235k/yr HybridFull Time
Build AI infrastructure and platform software; strong software engineering, distributed systems, production AI experience.
Python, TypeScript, C#, APIs, Distributed Systems, LLM/AI Systems, Tool/Skill Abstractions, LangChain, Data Pipelines
Explore Jobs