25 ai ml infrastructure engineer jobs at 20 companies in Epping, NH
2w
Save
Mark Applied
Hide
Global AI/ML Engineer Senior Manager
Boston or Atlanta
$173k-$211k/yr OnsiteFull Time
10+ YOEBachelor in CS/Engineering or related; 10+ years software/IT experience; Proven AI-driven application and SaaS implementation; frontend/backend development; cloud and infrastructure-as-code; DevOps and CI/CD experience.
React, Python, Java, Typescript, AWS, Kubernetes, Terraform, pgvector, chromadb, Helm, Neo4J, GraphQL, Jenkins, RDS, Batch, Lambda, Fargate, Step Functions, SQS, SNS, FastAPI, NextJS, Websockets, RabbitMQ, Kafka
2w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
2w
Save
Mark Applied
Hide
AI Platform Engineer
Boston or Springfield or New York City
$164k-$215k/yr HybridFull Time
5+ YOE5+ years platform/infrastructure/SRE experience, cloud-native Kubernetes expertise, CKA/CKAD or AWS certifications, IaC/GitOps experience, AI/ML infrastructure and platform ownership from design to production.
Kubernetes, Terraform, Pulumi, ArgoCD, vLLM, Triton, Ray Serve, AWS, GCP, Azure, Degreed
1mo
Save
Mark Applied
Hide
Lead AI Engineer
Boston, Massachusetts, United States
$150k-$190k/yr HybridFull Time
7+ YOE7+ years in software/ML engineering with expertise in LLMs, RAG, AI Agents, production ML systems, Python/SQL, cloud infrastructure, and leadership on cross-functional initiatives.
Python, SQL, OpenAI, Anthropic, Gemini, Mistral, LangGraph, LangChain, LlamaIndex, MCP, Vector Databases, AWS, GCP, Docker, Kubernetes
1mo
Save
Mark Applied
Hide
Principal Engineer, Data Infrastructure
Boston, Massachusetts, United States
$244k-$366k/yr OnsiteFull Time
10+ YOE10+ years building and operating distributed data systems; expertise in ingestion/CDC, stream processing, batch orchestration, lakehouse patterns, governance, SLOs, and applying AI/ML to data platforms.
Kafka, PubSub, Flink, Spark, Beam, Airflow, Dagster, Iceberg, Delta, Hudi, Snowflake, BigQuery, object storage
1w
Save
Mark Applied
Hide
Senior Developer Relations Engineer, GKE and AI Infrastructure
Sunnyvale or Cambridge or Kirkland or New York City or Raleigh or Durham or Seattle
$163k-$236k/yr OnsiteFull Time
5+ YOEBachelor's in CS or equivalent,5+ years technical experience,2+ years running AI/ML workloads on GPUs/TPUs with Kubernetes/GKE,2+ years producing developer content,proficiency in Python and strong programming skills.
Kubernetes, GKE, GPU, TPU, Python, C++, Java, Vertex AI, Google Cloud
3mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Cambridge or Richmond or McLean or New York or San Jose or San Francisco
$286k-$392k/yr RemoteFull Time
10+ YOE10+ years AI/ML engineering; Python/Go/Scala/Java; distributed compute; CPU/GPU infrastructure; ML/AI workloads.
Python, Go, Scala, Java, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda
1mo
Save
Mark Applied
Hide
Director AI Engineering Platform
United States or Southfield or San Francisco or Seattle or Boston or New York City or Los Angeles or San Diego
$218k-$319k/yr RemoteFull Time
12+ YOE5+ MgmtBS in CS/Engineering (MS preferred), 12+ years software engineering experience with platform/infrastructure focus, 5+ years managing managers, experience delivering enterprise-scale platform capabilities and partnering with AI/ML orgs.
AWS, Microsoft, Databricks, LiteLLM, Portkey, Traefik AI Gateway, MCP, Expressway, LLM APIs, CI/CD, FinOps, AI gateway
1mo
Save
Mark Applied
Hide
AI Solutions Architect - East Region
Hartford or Washington or Tampa or Atlanta or Boston or Charlotte or Trenton or New York or Philadelphia or Pittsburgh
$185k-$235k/yr OnsiteFull Time
10+ YOESenior technical pre-sales architect with 10+ years of experience designing AI/ML infrastructure and platforms, hands-on NVIDIA and cloud experience, strong presentation and whiteboarding skills, and a bachelor’s degree in computer science, engineering, or related field.
NVIDIA DGX, NVIDIA HGX, CUDA, NVIDIA AI Enterprise (NVAIE), NeMo, Omniverse, AWS, Microsoft Azure, GCP, Dell, HPE, Cisco, NetApp, Pure Storage, Vast Data, Advanced Technology Center (ATC), MLOps
1w
Save
Mark Applied
Hide
Director, AI Platform Engineering
San Francisco or Boston or Waltham or New York City
$200k-$230k/yr HybridFull Time
10+ YOE5+ MgmtRequires 10+ years in software engineering, 5+ years in engineering leadership, production platform expertise, AI/ML ecosystem knowledge, cloud infrastructure experience, and Python backend development.
LangGraph, MCP, AG-UI, CrewAI, AutoGen, OpenAI, Anthropic, AWS Bedrock, Kubernetes, Docker, Terraform, Python, FastAPI, SSE, WebSocket, GraphQL, dbt, Module Federation
2w
Save
Mark Applied
Hide
Staff/Principal DevOps Engineer, AI Inference
Cambridge, Massachusetts, United States
$192k-$272k/yr OnsiteFull Time
Expertise operating GPU/accelerator infrastructure for ML, Kubernetes and AWS deployment experience, infrastructure-as-code (Terraform, Helm), Python proficiency, networking and performance optimization for low-latency inference.
Kubernetes, vLLM, Triton Inference Server, TGI, Terraform, Helm, EKS, EC2, S3, EFA, IAM, NCCL, Python, Rust, Go, CUDA
2mo
Save
Mark Applied
Hide
Principal Engineer
Cambridge, Massachusetts, United States
$188k-$259k/yr OnsiteFull Time
Senior individual-contributor software engineer experienced owning production ML/AI systems, designing distributed system architecture, deploying data infrastructure, and partnering with scientists and ML researchers.
Claude Code, Greenhouse
2mo
Save
Mark Applied
Hide
Sr. Software Engineer II (DevOps)
Boston, Massachusetts, United States
$119k-$221k/yr HybridFull Time
6+ YOE6+ years DevOps/SRE/platform engineering; 2+ years AI/ML infrastructure; Bachelor’s in CS/Engineering or equivalent; deep AWS, Terraform, observability, and Python/Go/TypeScript skills.
AWS, ECS, EKS, Lambda, SageMaker, Bedrock, S3, DynamoDB, Redshift, Terraform, Datadog, CloudWatch, Airflow, dbt, Dagster, Python, Go, TypeScript
2mo
Save
Mark Applied
Hide
Director of Product Management – AI Essentials
Spring or San Jose or Durham or Fort Collins or Andover
$170k-$413k/yr HybridFull Time
15+ YOE5+ MgmtBachelor's in CS/engineering required; 15+ years product experience with 5+ years leading product teams in AI/ML or data infrastructure. Experience with AI platforms, model serving, GPU ecosystems, GTM and monetization.
GenAI, GPU, MLOps, GreenLake, AI tools, AI/ML, SaaS, DevOps, agent frameworks
2mo
Save
Mark Applied
Hide
Machine Learning Engineer, Apple Store Online
Cambridge, Massachusetts, United States
OnsiteFull Time
Research and develop ML algorithms and models for product search, recommendations, personalization, generative AI, and optimize online retail systems and infrastructure.
2mo
Save
Mark Applied
Hide
Principal Security Engineer
Cambridge or United States
$132k-$238k/yr HybridFull Time
8+ YOE8+ years relevant experience, Bachelor's or equivalent in Computer Science/Security, deep application/infrastructure/cloud-native security expertise, AI/ML security experience, experience defining security architecture and threat models, proficiency in Python or Go, compliance experience.
Python, Go, Kubernetes
1mo
Save
Mark Applied
Hide
Sr. Technical Program Manager, AI Security
Cambridge or Seattle or United States
$146k-$234k/yr HybridFull Time
8+ YOE8+ years in technical or engineering program management in AI/ML environments; deep knowledge of AI/ML systems, MLOps, cloud infrastructure; program scoping, risk-based execution, stakeholder and vendor management, and metrics-driven decision making.
Kubernetes, Airflow, MLflow
2w
Save
Mark Applied
Hide
Senior Solution Consultant, Healthcare
Cambridge, Massachusetts, United States
$126k-$200k/yr RemoteFull Time
7+ YOE7+ years in software engineering/solutions consulting or technical leadership; experience with cloud infrastructure, APIs, DevOps, CI/CD, microservices, AI/ML, and enterprise customers; strong communication and problem-solving skills.
cloud infrastructure, APIs, DevOps, CI/CD, microservices, AI/ML
3w
Save
Mark Applied
Hide
Sr. Solutions Architect, Hi-Tech and Semiconductor
Boston, Massachusetts, United States
$154k-$208k/yr OnsiteFull Time
8+ YOE8+ years in technology domains,3+ years designing/implementing applications and infrastructure; experience with AI/ML, data analytics, storage, networking; semiconductor/EDA/manufacturing experience preferred.
AI/ML, GenAI, Analytics, Database, Storage, Electronic Design Automation, MES
1w
Save
Mark Applied
Hide
Faculty Positions in the Department of Civil and Environmental Engineering and the Schwarzman College of Computing
Cambridge, Massachusetts, United States
$140k-$150k/yr OnsiteFull Time
PhD required by start in a related science or engineering field; demonstrated research in AI/ML applied to ecosystems or sustainable infrastructure; ability to teach undergraduate and graduate courses and advise students.