346 ai infrastructure engineer jobs at 206 companies in Chatham, NJ
7h
Save
Mark Applied
Hide
AI Infrastructure Engineer
New York City, New York, United States
$215k-$350k/yr HybridFull Time
Linux infrastructure administration, KVM or containerization, DevOps toolchains, Python or Bash automation, GPU-based compute or AI/ML infrastructure; bachelor's degree preferred.
Linux, KVM, Docker, Kubernetes, Python, Bash, FortiGate, FortiManager, FortiAnalyzer
2d
Save
Mark Applied
Hide
AI Infrastructure Engineer
San Francisco or New York City
$350k-$475k/yr OnsiteFull Time
4+ YOE4+ years operating large-scale distributed systems in production; expertise in Linux, networking, complex failure debugging, and Python, Go, or C++; on-call experience required.
Python, Go, C++, Linux, PyTorch, Ray, Slurm, Kubernetes, InfiniBand, RDMA, NCCL, RLHF, PPO, DPO
2w
Save
Mark Applied
Hide
AI Infrastructure Engineer
New York City, New York, United States
OnsiteFull Time
3+ YOERequires 3+ years in a relevant technical domain, production distributed-systems experience, cloud expertise, infrastructure automation, software development, incident resolution, and knowledge of security, scalability, and reliability.
Python, Docker, AWS, Azure, ECS, Lambda, API Gateway, OpenTofu, Terraform, Datadog, CI/CD
2mo
Save
Mark Applied
Hide
Gen AI Infrastructure Engineer
Woodbridge or New York City or Atlanta or Boston or Chicago or Dallas or Delaware or Denver or Garden City or Cayman Islands or Greenwich or Houston or Los Angeles or Miami or Naples or Nevada or Palm Beach or San Diego or San Francisco or Seattle or Stuart or Washington
$160k-$200k/yr HybridFull Time
7+ YOE7+ years in DevOps/platform/cloud infrastructure engineering; strong AWS (IAM, CloudFormation, Lambda, API Gateway, VPC, CloudWatch, SSM, Secrets Manager, ECR); AWS CDK/CloudFormation/Terraform; CI/CD (Bitbucket/GitHub Actions, OIDC); container and datastore operations; security fundamentals.
AWS Bedrock, AgentCore, Lambda, API Gateway, AWS CDK, CloudFormation, Terraform, Bitbucket Pipelines, GitHub Actions, OIDC, IAM, VPC, CloudWatch, SSM, Secrets Manager, ECR, Neo4j, Neptune, Redis, Milvus, VectorDB
1mo
Save
Mark Applied
Hide
Lead Infrastructure Engineer – Infrastructure (IBM Power/AIX) with AI/Automation
Jersey City, New Jersey, United States
$143k-$185k/yr OnsiteFull Time
5+ YOE5+ years infrastructure engineering experience with IBM Power/AIX, PowerVM/VIOS, HMC, GPFS; Unix shell scripting, Python and Ansible; experience using enterprise AI for infrastructure automation and validation.
IBM Power, AIX, PowerVM, VIOS, HMC, GPFS, Unix shell scripting, Python, Ansible
1mo
Save
Mark Applied
Hide
AI-Enabled Infrastructure and Systems Engineer
New York, New York, United States
$162k-$200k/yr HybridFull Time
5+ YOE5+ years infrastructure engineering experience; cloud (AWS/Azure/GCP) and IaC (Terraform/CloudFormation/ARM/Bicep/Ansible) proficiency; scripting (Python/Java/Golang); experience supporting AI/ML workloads and platform engineering.
Terraform, Ansible, CloudFormation, ARM/Bicep, Python, Java, Golang, AWS, Microsoft Azure ML, Microsoft Azure Foundry, AWS Bedrock, Google Vertex
1mo
Save
Mark Applied
Hide
AI Infrastructure Engineer, Sandbox Platform
San Francisco or Seattle or New York City
$180k-$225k/yr OnsiteFull Time
4+ YOE4+ years building high-performance systems software; deep Linux internals, containerization/virtualization, systems programming (Go/Rust/C/C++); strong debugging and API/SDK design skills.
Docker, Firecracker, gVisor, QEMU, Kata Containers, Go, Rust, C/C++, Kubernetes, OpenHands, Agent2Agent, MCP, CRIU
2mo
Save
Mark Applied
Hide
AI Engineer - Cloud Infrastructure
New York, New York, United States
$175k-$275k/yr OnsiteFull Time
7+ YOE7+ years experience operating cloud and Kubernetes-native infrastructure at scale; hands-on with AWS, EKS, Terraform, Helm; strong debugging, incident response, and capacity planning skills.
AWS, EKS, Terraform, Helm, Kubernetes, Python, Envoy, Istio, Cilium, eBPF, Rust, TypeScript, GCP, Azure, Oracle Cloud
2w
Save
Mark Applied
Hide
AI & HPC Infrastructure Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irvine or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$266k/yr HybridFull Time
5+ YOERequires 5+ years designing AI infrastructure, accelerated computing, clusters, orchestration, and automation; bachelor's degree or equivalent experience. Strong Kubernetes, Python, Terraform, and cloud expertise required.
Slurm, Run:ai, Kubernetes, NVIDIA Base Command Manager (BCM), NVIDIA NGC, NCCL, NVLink, CUDA, TensorRT-LLM, vLLM, SGLang, Triton Inference Server, NVIDIA Dynamo, llm-d, MLPerf, NCCL tests, fio, iperf, InfiniBand, Ethernet, SONiC, NVMe, NVMe-oF, VAST, Weka, DDN, AWS, Azure, GCP, VMware, Nutanix, Python, Terraform, Ansible, REST, OpenAPI, JSON, YAML, TensorFlow, PyTorch, JAX, Jupyter notebooks, Google Colab, MCP
4w
Save
Mark Applied
Hide
Infrastructure engineer
New York City or Seattle or San Francisco or London
$140k-$274k/yr HybridFull Time
5+ YOE5+ years infrastructure/DevOps experience, production Kubernetes, Helm, Terraform/Pulumi, major cloud (AWS preferred), Python or Go, observability stacks (Prometheus, Grafana, ELK), and daily AI-assisted workflows.
Python, Go, AWS, GCP, Azure, Kubernetes, Helm, Terraform, Pulumi, Claude Code, Droid, Codex, Prometheus, Grafana, ELK
3w
Save
Mark Applied
Hide
Lead AI Engineer
Holmdel or Bethlehem or New York City
$119k-$195k/yr HybridFull Time
Advanced knowledge of machine learning engineering, distributed systems, cloud infrastructure, AI platforms, LLMs, RAG pipelines, orchestration, agentic frameworks, secure APIs, and enterprise governance.
Large Language Models (LLMs), retrieval-augmented generation (RAG), model orchestration frameworks, Agentic frameworks, API, cloud infrastructure, AI platforms
3d
Save
Mark Applied
Hide
AI Infrastructure Engineer - Recommendation & LLM
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$128k-$317k/yr OnsiteFull Time
3+ YOEBachelor's, master's, or Ph.D. in a technical field or equivalent experience; 3+ years in software, ML systems, or distributed systems; C++ or Python, data structures, distributed systems, and PyTorch or TensorFlow experience.
C++, Python, PyTorch, TensorFlow, CUDA, Triton, FlashAttention, CUDA Graph
1d
Save
Mark Applied
Hide
Senior Data Infrastructure Engineer
San Francisco or Paris or Seattle or Madrid or London or Berlin or New York City or Sydney or Mexico City
$150k-$200k/yr OnsiteFull Time
4+ YOERequires 4+ years in data engineering or infrastructure, strong Python and SQL, Airflow-scale operations, Spark, AWS, Terraform, Kubernetes, Docker, CI/CD, GitOps, reliability ownership, and AI coding tool experience.
Python, SQL, Apache Iceberg, Amazon S3, Flink, Kafka, Amazon MSK, dbt, Apache Kyuubi, Amazon EKS, Amazon Redshift, Rudderstack, Fivetran, DMS, Airflow, Amazon ECS, Lake Formation, StrongDM, SSO, Monte Carlo, Terraform, GitLab CI, GitOps, AWS, Apache Spark, Dagster, Prefect, Amazon IAM, AWS Glue, Amazon Athena, Kubernetes, Docker, Delta Lake, Hudi, Kinesis, Unity Catalog, Claude Code, Cursor
1w
Save
Mark Applied
Hide
Staff Infrastructure Engineer
United States or San Francisco or New York City or Chicago
$187k-$235k/yr RemoteFull Time
8+ YOERequires 8+ years in infrastructure, cloud, or platform engineering; deep AWS experience; Terraform and Kubernetes ownership; AI-assisted engineering fluency; and security/compliance experience in regulated environments.
Amazon Web Services (AWS), Kubernetes, Terraform, ArgoCD, GitHub Actions, Claude, OpenAI Codex, Cursor, GitHub Copilot, AWS Bedrock, Okta, OpenID Connect (OIDC), Security Assertion Markup Language (SAML), Envoy, Python, Go, Bash, Snowflake, IAM, RBAC
3mo
Save
Mark Applied
Hide
Infrastructure Engineer
New York or San Francisco or United States
$165k-$200k/yr HybridFull Time
Kubernetes production experience; IaC (Terraform/Helm); cloud (AWS/GCP); Python/Node.js; CI/CD (GitHub Actions/Spacelift); security and ML/AI infrastructure familiarity.
Kubernetes, Terraform, Helm, Python, Node.js, GitHub Actions, Spacelift, AWS, GCP, PyTorch, TensorFlow, Bash
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
3w
Save
Mark Applied
Hide
Senior DevOps / Infrastructure Engineer
New York City or United States
$180k-$250k/yr HybridFull Time
5+ YOE5+ years in DevOps, SRE, or infrastructure engineering; strong Linux, systemd, networking, shell, Ansible, Terraform, observability, automation, incident response, and AI-assisted engineering experience.
Ansible, Terraform, Atlantis, Kubernetes, Flux, Prometheus, Grafana, Loki, GitOps, SSH, Python, bash, Argo, MCP servers, EVM, GitHub, LLM tooling
3mo
Save
Mark Applied
Hide
Staff Software Engineer - AI Research Infrastructure
San Francisco or New York City
$199k-$270k/yr HybridFull Time
5+ YOEBS/MS or PhD in computer science; 5+ years of software engineering experience in distributed systems or infrastructure; strong experience with GPUs, clusters, and cloud platforms; proficient in systems languages and large-scale job orchestration.
C++, Rust, Go, Java, Scala, Kubernetes, Slurm, Ray, GPU, Cloud computing, Distributed systems
2mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York or San Francisco or McLean or Cambridge or San Jose or Plano
$209k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE +6 years or Master's +4 years; 6+ years programming with Python/Go/Scala/Java; experience deploying scalable AI on cloud; LLM, inference, similarity search, VectorDBs, guardrails, model evaluation, and optimization experience; leadership and research literacy.
Python, Go, Scala, Java, C++, C#, Golang, AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure
1mo
Save
Mark Applied
Hide
Sr AI Engineer I
New York or Sunrise or Phoenix
$123k-$215k/yr OnsiteFull Time
5+ YOE5+ years software engineering experience with production LLM or applied ML systems; strong backend, APIs, data pipelines, and cloud infrastructure skills; experience shipping AI/agentic systems and owning production reliability.
Python, Go, TypeScript, AWS, GCP, Kubernetes, REST, gRPC, Kafka, LLMs
Explore Jobs