17 ai ml infrastructure engineer jobs at 12 companies in Gardner, MA
2w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
3w
Save
Mark Applied
Hide
AI Platform Engineer
Boston or Springfield or New York City
$164k-$215k/yr HybridFull Time
5+ YOE5+ years platform/infrastructure/SRE experience, cloud-native Kubernetes expertise, CKA/CKAD or AWS certifications, IaC/GitOps experience, AI/ML infrastructure and platform ownership from design to production.
Kubernetes, Terraform, Pulumi, ArgoCD, vLLM, Triton, Ray Serve, AWS, GCP, Azure, Degreed
2w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor’s degree plus 6 years or master’s degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java; cloud AI deployment experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Microsoft Azure, C++, C#, Golang
1w
Save
Mark Applied
Hide
Senior Developer Relations Engineer, GKE and AI Infrastructure
Sunnyvale or Cambridge or Kirkland or New York City or Raleigh or Durham or Seattle
$163k-$236k/yr OnsiteFull Time
5+ YOEBachelor's in CS or equivalent,5+ years technical experience,2+ years running AI/ML workloads on GPUs/TPUs with Kubernetes/GKE,2+ years producing developer content,proficiency in Python and strong programming skills.
Kubernetes, GKE, GPU, TPU, Python, C++, Java, Vertex AI, Google Cloud
3mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Cambridge or Richmond or McLean or New York or San Jose or San Francisco
$286k-$392k/yr RemoteFull Time
10+ YOE10+ years AI/ML engineering; Python/Go/Scala/Java; distributed compute; CPU/GPU infrastructure; ML/AI workloads.
Python, Go, Scala, Java, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda
3w
Save
Mark Applied
Hide
Senior Software Engineer, AI/ML, NotebookLM Content Studio
New York or Cambridge or Mountain View
$174k-$253k/yr OnsiteFull Time
5+ YOEBachelor's in CS/Math or equivalent,5 years software development (Python,C++,Java),3 years ML infrastructure and ML field experience,EMR? (not mentioned)
Python, C++, Java, NotebookLM, Gemini API, TPU, GPU, LLMs
1w
Save
Mark Applied
Hide
Director, AI Platform Engineering
San Francisco or Boston or Waltham or New York City
$200k-$230k/yr HybridFull Time
10+ YOE5+ MgmtRequires 10+ years in software engineering, 5+ years in engineering leadership, production platform expertise, AI/ML ecosystem knowledge, cloud infrastructure experience, and Python backend development.
LangGraph, MCP, AG-UI, CrewAI, AutoGen, OpenAI, Anthropic, AWS Bedrock, Kubernetes, Docker, Terraform, Python, FastAPI, SSE, WebSocket, GraphQL, dbt, Module Federation
2w
Save
Mark Applied
Hide
Staff/Principal DevOps Engineer, AI Inference
Cambridge, Massachusetts, United States
$192k-$272k/yr OnsiteFull Time
Expertise operating GPU/accelerator infrastructure for ML, Kubernetes and AWS deployment experience, infrastructure-as-code (Terraform, Helm), Python proficiency, networking and performance optimization for low-latency inference.
Kubernetes, vLLM, Triton Inference Server, TGI, Terraform, Helm, EKS, EC2, S3, EFA, IAM, NCCL, Python, Rust, Go, CUDA
2mo
Save
Mark Applied
Hide
Principal Engineer
Cambridge, Massachusetts, United States
$188k-$259k/yr OnsiteFull Time
Senior individual-contributor software engineer experienced owning production ML/AI systems, designing distributed system architecture, deploying data infrastructure, and partnering with scientists and ML researchers.
Claude Code, Greenhouse
2mo
Save
Mark Applied
Hide
Machine Learning Engineer, Apple Store Online
Cambridge, Massachusetts, United States
OnsiteFull Time
Research and develop ML algorithms and models for product search, recommendations, personalization, generative AI, and optimize online retail systems and infrastructure.
1w
Save
Mark Applied
Hide
AI Platform Delivery Director
Boston or Springfield or New York City
$148k-$195k/yr HybridFull Time
5+ YOE3+ MgmtRequires 5+ years of software engineering experience, 3+ years managing engineers, cloud-native architecture knowledge, AI/ML infrastructure exposure, a bachelor's degree, and US work authorization without sponsorship.
Kubernetes, AWS, GCP, Azure, Degreed
2mo
Save
Mark Applied
Hide
Sr. Technical Program Manager, AI Security
Cambridge or Seattle or United States
$146k-$234k/yr HybridFull Time
8+ YOE8+ years in technical or engineering program management in AI/ML environments; deep knowledge of AI/ML systems, MLOps, cloud infrastructure; program scoping, risk-based execution, stakeholder and vendor management, and metrics-driven decision making.
Kubernetes, Airflow, MLflow
2mo
Save
Mark Applied
Hide
Principal Security Engineer
Cambridge or United States
$132k-$238k/yr HybridFull Time
8+ YOE8+ years relevant experience, Bachelor's or equivalent in Computer Science/Security, deep application/infrastructure/cloud-native security expertise, AI/ML security experience, experience defining security architecture and threat models, proficiency in Python or Go, compliance experience.
Python, Go, Kubernetes
3w
Save
Mark Applied
Hide
Senior Solution Consultant, Healthcare
Cambridge, Massachusetts, United States
$126k-$200k/yr RemoteFull Time
7+ YOE7+ years in software engineering/solutions consulting or technical leadership; experience with cloud infrastructure, APIs, DevOps, CI/CD, microservices, AI/ML, and enterprise customers; strong communication and problem-solving skills.
cloud infrastructure, APIs, DevOps, CI/CD, microservices, AI/ML
2mo
Save
Mark Applied
Hide
Manager, Machine Learning, Apple Store Online
Cambridge, Massachusetts, United States
OnsiteFull Time
Hands-on applied ML engineering leadership to research and develop models for search, recommendation, personalization, generative AI, and optimize infrastructure for the Apple Online Store.
1w
Save
Mark Applied
Hide
Faculty Positions in the Department of Civil and Environmental Engineering and the Schwarzman College of Computing
Cambridge, Massachusetts, United States
$140k-$150k/yr OnsiteFull Time
PhD required by start in a related science or engineering field; demonstrated research in AI/ML applied to ecosystems or sustainable infrastructure; ability to teach undergraduate and graduate courses and advise students.
1mo
Save
Mark Applied
Hide
Sr. Product Manager, Services
Maynard, Massachusetts, United States
$150k-$170k/yr HybridFull Time
7+ YOEBS/BA in CS/Engineering required; 7+ years product management in services/infrastructure; experience with AI/ML, HPC, cloud or data center; strong services and commercialization skills; cross-functional leadership and customer engagement.
Kubernetes