Berkeley Heights • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Berkeley Heights • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Berkeley Heights • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Berkeley Heights • 50 milesRemote · Hybrid · Onsite · Field · All Environments
95 ai ml infrastructure engineer jobs at 59 companies in Berkeley Heights, NJ
2w
Save
Mark Applied
Hide
Senior AI/ML Engineer
New York City, New York, United States
RemoteFull Time
Build inference infrastructure, own model evaluation pipelines, optimize latency, and integrate orchestration engines with frontier large language models.
1mo
Save
Mark Applied
Hide
AI-Enabled Infrastructure and Systems Engineer
New York, New York, United States
$162k-$200k/yr HybridFull Time
5+ YOE5+ years infrastructure engineering experience; cloud (AWS/Azure/GCP) and IaC (Terraform/CloudFormation/ARM/Bicep/Ansible) proficiency; scripting (Python/Java/Golang); experience supporting AI/ML workloads and platform engineering.
Terraform, Ansible, CloudFormation, ARM/Bicep, Python, Java, Golang, AWS, Microsoft Azure ML, Microsoft Azure Foundry, AWS Bedrock, Google Vertex
1mo
Save
Mark Applied
Hide
Sr Lead Software Engineer - AWS - Lead AI/ML Platform Engineer
Jersey City, New Jersey, United States
$171k-$260k/yr OnsiteFull Time
5+ YOE5+ years software engineering experience, deep AWS and cloud infrastructure knowledge, production platform and architecture experience, strong client communication, and experience with responsible AI and AI-assisted development.
AWS, Kubernetes, EKS, AWS Sagemaker, Golang, Terraform, LLMs
3mo
Save
Mark Applied
Hide
Software Engineer, AI/ML (Infrastructure & Platform)
New York City or Tempe or San Francisco
$200k-$235k/yr HybridFull Time
Build AI infrastructure and platform software; strong software engineering, distributed systems, production AI experience.
Python, TypeScript, C#, APIs, Distributed Systems, LLM/AI Systems, Tool/Skill Abstractions, LangChain, Data Pipelines
3w
Save
Mark Applied
Hide
Recommendation Architecture AI/ML Infrastructure Engineer Intern (Data-Arch-TikTok Live) - 2027 Summer
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
OnsiteInternship
Pursuing a bachelor's or master's degree in AI, software development, computer science, computer engineering, or related field; strong C++ or Python skills; data structures, algorithms, systems, PyTorch or TensorFlow, and LLM knowledge.
C++, Python, PyTorch, TensorFlow, CUDA, Triton, FSDP, ZeRO, FlashAttention
2mo
Save
Mark Applied
Hide
General Application — Data & AI/ML Engineering
New York or United States
HybridFull Time
4+ YOE4+ years in data or ML engineering, strong Python and SQL, experience with Spark/dbt/Airflow, cloud data infrastructure (AWS/GCP/Azure), ML lifecycle and systems design; Bachelor's/Master's in CS/Engineering preferred.
Python, SQL, Spark, dbt, Airflow, AWS, GCP, Azure, Docker, Kubernetes
3mo
Save
Mark Applied
Hide
Infrastructure Engineer
New York or San Francisco or United States
$165k-$200k/yr HybridFull Time
Kubernetes production experience; IaC (Terraform/Helm); cloud (AWS/GCP); Python/Node.js; CI/CD (GitHub Actions/Spacelift); security and ML/AI infrastructure familiarity.
Kubernetes, Terraform, Helm, Python, Node.js, GitHub Actions, Spacelift, AWS, GCP, PyTorch, TensorFlow, Bash
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
1mo
Save
Mark Applied
Hide
Sr AI Engineer I
New York or Sunrise or Phoenix
$123k-$215k/yr OnsiteFull Time
5+ YOE5+ years software engineering experience with production LLM or applied ML systems; strong backend, APIs, data pipelines, and cloud infrastructure skills; experience shipping AI/agentic systems and owning production reliability.
Python, Go, TypeScript, AWS, GCP, Kubernetes, REST, gRPC, Kafka, LLMs
2w
Save
Mark Applied
Hide
Software Engineer, ML Platform
Denver or San Francisco or New York City or San Jose or Scottsdale
$160k-$240k/yr HybridFull Time
4+ YOERequires 4+ years of software engineering experience in Python, Ruby, or Java; ML infrastructure and platform-service experience; cloud-platform experience; and familiarity with AI frameworks and AI-assisted development tools.
Python, Ruby, Java, AWS, CI/CD
1mo
Save
Mark Applied
Hide
AI Platform Engineer
Boston or Springfield or New York City
$164k-$215k/yr HybridFull Time
5+ YOE5+ years platform/infrastructure/SRE experience, cloud-native Kubernetes expertise, CKA/CKAD or AWS certifications, IaC/GitOps experience, AI/ML infrastructure and platform ownership from design to production.
Kubernetes, Terraform, Pulumi, ArgoCD, vLLM, Triton, Ray Serve, AWS, GCP, Azure, Degreed
1mo
Save
Mark Applied
Hide
Founding AI Engineer
New York City, New York, United States
OnsiteFull Time
Hands-on ML/AI experience, strong backend engineering in a typed language, cloud infrastructure and MLOps experience, and comfort in fast-moving early-stage environments.
Machine Learning, LLMs, computer vision, embeddings, retrieval, Go, Gemma, Qwen, AWS, Google Cloud Platform (GCP), SAM3, DynamoDB, OpenSearch, React Native, Claude Code, Codex, ECS, AWS Lambda, Step Functions
3mo
Save
Mark Applied
Hide
AI Engineer (Copy)
New York, New York, United States
$170k-$230k/yr OnsiteFull Time
5+ YOE5–10+ years software engineering; hands-on with LLM-based agents or RAG in production; Python; AI/ML frameworks; cloud infra (GCP preferred); strong system design and communication.
Python, GCP, AI/ML frameworks, APIs, Cloud infrastructure
4d
Save
Mark Applied
Hide
AVP — Network Automation & Infrastructure AI
Basking Ridge or Irving
$192k-$367k/yr HybridFull Time
10+ YOE5+ MgmtBachelor’s degree or equivalent experience; 10+ years in large-scale network or software engineering, 5+ years leading technical organizations, and expertise in cloud-native networks, automation, AI/ML, 5G, and autonomous operations.
AI/ML, TM Forum, O-RAN, 3GPP, Kubernetes, GitOps, SRE, MLOps, LLM, Google Cloud, AWS, Azure, 5G Core, NFV, SDN, CNF, VNF
1mo
Save
Mark Applied
Hide
Associate Manager, Production AI/ML Engineering, Advanced Informatics
Tarrytown or Armonk or Warren
$110k-$179k/yr OnsiteFull Time
7+ YOEBachelor's (Master's preferred) and 7+ years building and operating enterprise ML/platform infrastructure on AWS; Kubernetes, Python, SQL, API, Postgres, MLOps tooling, and informatics experience preferred.
Kubernetes, AWS, SageMaker, ECS, EC2, S3, Lambda, SNOMED CT, ICD-10, ICD-11, LOINC, RxNorm, OMOP CDM, RESTful APIs, Postgres, Python, SQL, Git, MLflow, W&B, Docker, Airflow, Prefect
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor’s degree plus 6 years or master’s degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java; cloud AI deployment experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Microsoft Azure, C++, C#, Golang
2w
Save
Mark Applied
Hide
Senior Director, AI / Machine Learning Data Engineer
New York City, New York, United States
$137k-$300k/yr OnsiteFull Time
15+ YOERequires a bachelor's degree or equivalent experience and 15+ years in software development, with expertise in enterprise AI/ML architecture, platforms, cloud infrastructure, APIs, microservices, CI/CD, governance, and observability.
AI/ML, APIs, microservices, cloud infrastructure, CI/CD, vector databases, retrieval systems, knowledge graphs, MLOps
3mo
Save
Mark Applied
Hide
Senior AI Engineer
New York or United States
RemoteFull Time
4+ YOE4+ years software/data engineering, 3+ years building AI/ML-driven products; Python and SQL; experience with AI frameworks and data pipelines; cloud infrastructure; production LLM/RAG; strong communication; startup experience preferred.
Python, SQL, HuggingFace, LangChain, Airflow, Dagster, AWS, GCP, Azure, LLM deployment, RAG
2w
Save
Mark Applied
Hide
Staff AI Platform Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York or Seattle or Toronto or Santa Barbara or San Diego
$180k-$273k/yr RemoteFull Time
7+ YOERequires 7+ years in AI/ML platform engineering, strong Python and/or TypeScript, distributed systems, APIs, evaluation, observability, and AI infrastructure experience; bachelor's degree or equivalent practical experience.
Python, TypeScript, JavaScript, React, Kubernetes, Docker, Terraform, LangChain, LangGraph, LlamaIndex, LiveKit, REST, gRPC, MCP, A2A
3w
Save
Mark Applied
Hide
Senior Developer Relations Engineer, GKE and AI Infrastructure
Sunnyvale or Cambridge or Kirkland or New York City or Raleigh or Durham or Seattle
$163k-$236k/yr OnsiteFull Time
5+ YOEBachelor's in CS or equivalent,5+ years technical experience,2+ years running AI/ML workloads on GPUs/TPUs with Kubernetes/GKE,2+ years producing developer content,proficiency in Python and strong programming skills.
Kubernetes, GKE, GPU, TPU, Python, C++, Java, Vertex AI, Google Cloud