34 ai ml infrastructure engineer jobs at 27 companies in Melrose, MA
1mo
Save
Mark Applied
Hide
Global AI/ML Engineer Senior Manager
Boston or Atlanta
$173k-$211k/yr OnsiteFull Time
10+ YOEBachelor in CS/Engineering or related; 10+ years software/IT experience; Proven AI-driven application and SaaS implementation; frontend/backend development; cloud and infrastructure-as-code; DevOps and CI/CD experience.
React, Python, Java, Typescript, AWS, Kubernetes, Terraform, pgvector, chromadb, Helm, Neo4J, GraphQL, Jenkins, RDS, Batch, Lambda, Fargate, Step Functions, SQS, SNS, FastAPI, NextJS, Websockets, RabbitMQ, Kafka
3mo
Save
Mark Applied
Hide
Senior AI Infrastructure Platform Engineer, Assistant Vice President
Quincy or Austin
$90k-$158k/yr OnsiteFull Time
5+ YOELead GenAI/Agentic AI projects; strong full-stack development and architecture; collaboration with business and IT; experience with cloud and AI/ML tools.
Python, FastAPI, Unix, Docker, PostgreSQL, Lang Chain, Kubernetes, Databricks, API Management, AWS, Azure, OpenAI
1w
Save
Mark Applied
Hide
Staff AI Infrastructure Engineer -
Costa Mesa or Seattle or Washington or Boston
$220k-$292k/yr OnsiteFull Time
7+ YOERequires 7+ years building production-scale ML systems, proficiency in Python, Go, or C++, distributed systems expertise, Docker/Kubernetes, distributed training, data pipelines, technical leadership, and Top Secret clearance eligibility.
MLOps, Python, Go, C++, Docker, Kubernetes, PyTorch Distributed, Ray, Slurm, Megatron-LM, AWS Trainium, Google TPUs, RLHF/DPO, CI/CD
3mo
Save
Mark Applied
Hide
Senior AI Infrastructure Platform Engineer, Assistant Vice President
Quincy or Austin
$90k-$158k/yr HybridFull Time
5+ YOELead/architect AI automation platforms; hands-on development with AI/ML, cloud, and DevOps; senior engineer capable of driving projects and collaborating with cross-functional teams.
Python, FastAPI, Unix, Docker, Postgres, Lang Chain, Lang Graph, Kubernetes, Databricks, API Management, AWS, Azure, OpenAI, Azure Foundry, Sagemaker, Lambda, EKS
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
1mo
Save
Mark Applied
Hide
AI Platform Engineer
Boston or Springfield or New York City
$164k-$215k/yr HybridFull Time
5+ YOE5+ years platform/infrastructure/SRE experience, cloud-native Kubernetes expertise, CKA/CKAD or AWS certifications, IaC/GitOps experience, AI/ML infrastructure and platform ownership from design to production.
Kubernetes, Terraform, Pulumi, ArgoCD, vLLM, Triton, Ray Serve, AWS, GCP, Azure, Degreed
2mo
Save
Mark Applied
Hide
Lead AI Engineer
Boston, Massachusetts, United States
$150k-$190k/yr HybridFull Time
7+ YOE7+ years in software/ML engineering with expertise in LLMs, RAG, AI Agents, production ML systems, Python/SQL, cloud infrastructure, and leadership on cross-functional initiatives.
Python, SQL, OpenAI, Anthropic, Gemini, Mistral, LangGraph, LangChain, LlamaIndex, MCP, Vector Databases, AWS, GCP, Docker, Kubernetes
2mo
Save
Mark Applied
Hide
Principal Engineer, Data Infrastructure
Boston, Massachusetts, United States
$244k-$366k/yr OnsiteFull Time
10+ YOE10+ years building and operating distributed data systems; expertise in ingestion/CDC, stream processing, batch orchestration, lakehouse patterns, governance, SLOs, and applying AI/ML to data platforms.
Kafka, PubSub, Flink, Spark, Beam, Airflow, Dagster, Iceberg, Delta, Hudi, Snowflake, BigQuery, object storage
1mo
Save
Mark Applied
Hide
Senior ASIC Front End Infrastructure Engineer
Santa Clara or Durham or Austin or Westford
$184k-$357k/yr OnsiteFull Time
8+ YOEMaster's degree or equivalent in engineering or computer science, 8+ years of relevant experience, programming proficiency, AI automation, distributed build systems, CI pipelines, and ASIC or CPU verification knowledge.
Python, Perl, Make, Jenkins, ML, DL, AI, Continuous Integration
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor’s degree plus 6 years or master’s degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java; cloud AI deployment experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Microsoft Azure, C++, C#, Golang
2d
Save
Mark Applied
Hide
Software Engineer, Search, AI/ML
Cambridge, Massachusetts, United States
$147k-$210k/yr OnsiteFull Time
2+ YOEBachelor’s degree or equivalent experience, 2 years of C++ software development, 1 year of ML infrastructure and another ML specialty, plus system design and large-scale distributed systems experience.
C++, SQL, R, Python
3mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Cambridge or Richmond or McLean or New York or San Jose or San Francisco
$286k-$392k/yr RemoteFull Time
10+ YOE10+ years AI/ML engineering; Python/Go/Scala/Java; distributed compute; CPU/GPU infrastructure; ML/AI workloads.
Python, Go, Scala, Java, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda
6d
Save
Mark Applied
Hide
AI Storage Solutions Lead, Solutions Architecture
Santa Clara or Seattle or Hopkinton
$143k-$185k/yr FieldFull Time
5+ YOEBachelor's degree and 5+ years in enterprise storage, data infrastructure, solutions architecture, systems engineering, or technical pre-sales; requires customer-environment troubleshooting and AI/ML infrastructure expertise.
Linux, Kubernetes
2mo
Save
Mark Applied
Hide
AI Solutions Architect - East Region
Hartford or Washington or Tampa or Atlanta or Boston or Charlotte or Trenton or New York or Philadelphia or Pittsburgh
$185k-$235k/yr OnsiteFull Time
10+ YOESenior technical pre-sales architect with 10+ years of experience designing AI/ML infrastructure and platforms, hands-on NVIDIA and cloud experience, strong presentation and whiteboarding skills, and a bachelor’s degree in computer science, engineering, or related field.
NVIDIA DGX, NVIDIA HGX, CUDA, NVIDIA AI Enterprise (NVAIE), NeMo, Omniverse, AWS, Microsoft Azure, GCP, Dell, HPE, Cisco, NetApp, Pure Storage, Vast Data, Advanced Technology Center (ATC), MLOps
2w
Save
Mark Applied
Hide
Forward Deployment Engineer
Boston, Massachusetts, United States
FieldFull Time
10+ YOERequires 10+ years in engineering, data, analytics engineering, or AI/ML with mandatory pharma or life sciences experience, production AI delivery, Python, SQL, cloud infrastructure, data pipelines, APIs, and client-facing leadership.
Python, SQL, Databricks, Delta Lake, Mosaic AI, Genie, Snowflake, Snowpark, Cortex AI, Cortex Analyst, AWS, Bedrock Agents, SageMaker, Claude, Anthropic API, Model Context Protocol, RAGAS, HIPAA, GDPR, AWS Certified AI Practitioner (AIF-C01), Databricks Certified Generative AI Engineer Associate, SnowPro Advanced Data Engineer (DEA-C01), Claude Certified Architect Foundations (CCA-F)
3w
Save
Mark Applied
Hide
Director, AI Platform Engineering
San Francisco or Boston or Waltham or New York City
$200k-$230k/yr HybridFull Time
10+ YOE5+ MgmtRequires 10+ years in software engineering, 5+ years in engineering leadership, production platform expertise, AI/ML ecosystem knowledge, cloud infrastructure experience, and Python backend development.
LangGraph, MCP, AG-UI, CrewAI, AutoGen, OpenAI, Anthropic, AWS Bedrock, Kubernetes, Docker, Terraform, Python, FastAPI, SSE, WebSocket, GraphQL, dbt, Module Federation
3d
Save
Mark Applied
Hide
Application Security Engineer I
Boston, Massachusetts, United States
$96k-$120k/yr HybridFull Time
0+ YOE0–2 years in cybersecurity, application security, software engineering, or related fields; familiarity with secure coding, vulnerability management, threat modeling, cloud infrastructure, SDLC tools, and a programming or scripting language.
AWS, Kubernetes, GitHub, CI/CD, Python, Go, Java, AI, ML
1mo
Save
Mark Applied
Hide
Staff/Principal DevOps Engineer, AI Inference
Cambridge, Massachusetts, United States
$192k-$272k/yr OnsiteFull Time
Expertise operating GPU/accelerator infrastructure for ML, Kubernetes and AWS deployment experience, infrastructure-as-code (Terraform, Helm), Python proficiency, networking and performance optimization for low-latency inference.
Kubernetes, vLLM, Triton Inference Server, TGI, Terraform, Helm, EKS, EC2, S3, EFA, IAM, NCCL, Python, Rust, Go, CUDA
2mo
Save
Mark Applied
Hide
Principal Engineer
Cambridge, Massachusetts, United States
$188k-$259k/yr OnsiteFull Time
Senior individual-contributor software engineer experienced owning production ML/AI systems, designing distributed system architecture, deploying data infrastructure, and partnering with scientists and ML researchers.
Claude Code, Greenhouse
2mo
Save
Mark Applied
Hide
Sr. Software Engineer II (DevOps)
Boston, Massachusetts, United States
$119k-$221k/yr HybridFull Time
6+ YOE6+ years DevOps/SRE/platform engineering; 2+ years AI/ML infrastructure; Bachelor’s in CS/Engineering or equivalent; deep AWS, Terraform, observability, and Python/Go/TypeScript skills.
AWS, ECS, EKS, Lambda, SageMaker, Bedrock, S3, DynamoDB, Redshift, Terraform, Datadog, CloudWatch, Airflow, dbt, Dagster, Python, Go, TypeScript