19 ml infrastructure engineer jobs at 15 companies in Bourne, MA
2mo
Save
Mark Applied
Hide
Staff Machine Learning Engineer, ML Infrastructure
Boston, Massachusetts, United States
$184k-$269k/yr HybridFull Time
8+ YOE8+ years software/ML engineering; deep cloud ML infra on Kubernetes; Ray experience; AWS and Kafka; Python; staff-level technical leadership.
Ray, Kubernetes, KServe, Triton, vLLM, Kubeflow, Argo, AWS (EKS, S3, IAM), Kafka, CI/CD, infrastructure-as-code, Python, Go/C++/Rust (bonus)
2mo
Save
Mark Applied
Hide
Staff Software Engineer, ML Infrastructure
Boston, Massachusetts, United States
$147k-$215k/yr HybridFull Time
8+ YOE8+ years in software engineering; strong distributed systems; Kubernetes and AWS; Python; ML infra experience preferred; strong communication; staff-level technical leadership.
Kubernetes, AWS, Kafka, Ray, KServe, Triton, vLLM, Python, Go, C++, Rust
1w
Save
Mark Applied
Hide
Member of Technical Staff, ML Engineer
Boston, Massachusetts, United States
OnsiteFull Time
3+ YOE3+ years building and operating ML training or inference infrastructure; distributed training and model-serving experience; strong software engineering and ML fluency to debug training and inference; cloud and IaC experience preferred.
PyTorch, Ray, vLLM, SGLang, Triton, CUDA, GCP, AWS, Terraform
1mo
Save
Mark Applied
Hide
Principal Engineer, Data Infrastructure
Boston, Massachusetts, United States
$244k-$366k/yr OnsiteFull Time
10+ YOE10+ years building and operating distributed data systems; expertise in ingestion/CDC, stream processing, batch orchestration, lakehouse patterns, governance, SLOs, and applying AI/ML to data platforms.
Kafka, PubSub, Flink, Spark, Beam, Airflow, Dagster, Iceberg, Delta, Hudi, Snowflake, BigQuery, object storage
2w
Save
Mark Applied
Hide
Global AI/ML Engineer Senior Manager
Boston or Atlanta
$173k-$211k/yr OnsiteFull Time
10+ YOEBachelor in CS/Engineering or related; 10+ years software/IT experience; Proven AI-driven application and SaaS implementation; frontend/backend development; cloud and infrastructure-as-code; DevOps and CI/CD experience.
React, Python, Java, Typescript, AWS, Kubernetes, Terraform, pgvector, chromadb, Helm, Neo4J, GraphQL, Jenkins, RDS, Batch, Lambda, Fargate, Step Functions, SQS, SNS, FastAPI, NextJS, Websockets, RabbitMQ, Kafka
3mo
Save
Mark Applied
Hide
Senior AI Infrastructure Platform Engineer, Assistant Vice President
Quincy or Austin
$90k-$158k/yr OnsiteFull Time
5+ YOELead GenAI/Agentic AI projects; strong full-stack development and architecture; collaboration with business and IT; experience with cloud and AI/ML tools.
Python, FastAPI, Unix, Docker, PostgreSQL, Lang Chain, Kubernetes, Databricks, API Management, AWS, Azure, OpenAI
3mo
Save
Mark Applied
Hide
Senior AI Infrastructure Platform Engineer, Assistant Vice President
Quincy or Austin
$90k-$158k/yr HybridFull Time
5+ YOELead/architect AI automation platforms; hands-on development with AI/ML, cloud, and DevOps; senior engineer capable of driving projects and collaborating with cross-functional teams.
Python, FastAPI, Unix, Docker, Postgres, Lang Chain, Lang Graph, Kubernetes, Databricks, API Management, AWS, Azure, OpenAI, Azure Foundry, Sagemaker, Lambda, EKS
2w
Save
Mark Applied
Hide
AI Platform Engineer
Boston or Springfield or New York City
$164k-$215k/yr HybridFull Time
5+ YOE5+ years platform/infrastructure/SRE experience, cloud-native Kubernetes expertise, CKA/CKAD or AWS certifications, IaC/GitOps experience, AI/ML infrastructure and platform ownership from design to production.
Kubernetes, Terraform, Pulumi, ArgoCD, vLLM, Triton, Ray Serve, AWS, GCP, Azure, Degreed
1mo
Save
Mark Applied
Hide
Lead AI Engineer
Boston, Massachusetts, United States
$150k-$190k/yr HybridFull Time
7+ YOE7+ years in software/ML engineering with expertise in LLMs, RAG, AI Agents, production ML systems, Python/SQL, cloud infrastructure, and leadership on cross-functional initiatives.
Python, SQL, OpenAI, Anthropic, Gemini, Mistral, LangGraph, LangChain, LlamaIndex, MCP, Vector Databases, AWS, GCP, Docker, Kubernetes
4w
Save
Mark Applied
Hide
Software Engineer II, MLOps
Boston, Massachusetts, United States
$125k-$175k/yr OnsiteFull Time
2+ YOE2+ years software engineering experience with ML infrastructure in cloud environments; degree or equivalent; experience with Python or Java; familiarity with ML lifecycle and cloud design patterns; strong collaboration and problem-solving skills.
AWS SageMaker, Lambda, ECS, Python, Java
2mo
Save
Mark Applied
Hide
Sr. Software Engineer II (DevOps)
Boston, Massachusetts, United States
$119k-$221k/yr HybridFull Time
6+ YOE6+ years DevOps/SRE/platform engineering; 2+ years AI/ML infrastructure; Bachelor’s in CS/Engineering or equivalent; deep AWS, Terraform, observability, and Python/Go/TypeScript skills.
AWS, ECS, EKS, Lambda, SageMaker, Bedrock, S3, DynamoDB, Redshift, Terraform, Datadog, CloudWatch, Airflow, dbt, Dagster, Python, Go, TypeScript
2mo
Save
Mark Applied
Hide
Principal Security Engineer
Cambridge or United States
$132k-$238k/yr HybridFull Time
8+ YOE8+ years relevant experience, Bachelor's or equivalent in Computer Science/Security, deep application/infrastructure/cloud-native security expertise, AI/ML security experience, experience defining security architecture and threat models, proficiency in Python or Go, compliance experience.
Python, Go, Kubernetes
1mo
Save
Mark Applied
Hide
Director AI Engineering Platform
United States or Southfield or San Francisco or Seattle or Boston or New York City or Los Angeles or San Diego
$218k-$319k/yr RemoteFull Time
12+ YOE5+ MgmtBS in CS/Engineering (MS preferred), 12+ years software engineering experience with platform/infrastructure focus, 5+ years managing managers, experience delivering enterprise-scale platform capabilities and partnering with AI/ML orgs.
AWS, Microsoft, Databricks, LiteLLM, Portkey, Traefik AI Gateway, MCP, Expressway, LLM APIs, CI/CD, FinOps, AI gateway
1mo
Save
Mark Applied
Hide
Technical Lead Manager, MLOps
New York City or United States or Philadelphia or Boston
$199k-$241k/yr HybridFull Time
6+ YOEBachelor's degree plus 6+ years (or Master's plus 4+ years) in ML engineering; experience building ML platforms, training/serving infrastructure, feature stores, orchestration, monitoring, deployment pipelines; experience managing ML Platform/ML Ops teams; hands-on with Ray, Flink, Feast; cloud data tooling (AWS, Redshift, Databricks, Snowflake); s...
Ray, Flink, Feast, AWS, Redshift, Databricks, Snowflake, Python
1mo
Save
Mark Applied
Hide
AI Solutions Architect - East Region
Hartford or Washington or Tampa or Atlanta or Boston or Charlotte or Trenton or New York or Philadelphia or Pittsburgh
$185k-$235k/yr OnsiteFull Time
10+ YOESenior technical pre-sales architect with 10+ years of experience designing AI/ML infrastructure and platforms, hands-on NVIDIA and cloud experience, strong presentation and whiteboarding skills, and a bachelor’s degree in computer science, engineering, or related field.
NVIDIA DGX, NVIDIA HGX, CUDA, NVIDIA AI Enterprise (NVAIE), NeMo, Omniverse, AWS, Microsoft Azure, GCP, Dell, HPE, Cisco, NetApp, Pure Storage, Vast Data, Advanced Technology Center (ATC), MLOps
3w
Save
Mark Applied
Hide
Sr. Solutions Architect, Hi-Tech and Semiconductor
Boston, Massachusetts, United States
$154k-$208k/yr OnsiteFull Time
8+ YOE8+ years in technology domains,3+ years designing/implementing applications and infrastructure; experience with AI/ML, data analytics, storage, networking; semiconductor/EDA/manufacturing experience preferred.
AI/ML, GenAI, Analytics, Database, Storage, Electronic Design Automation, MES
1w
Save
Mark Applied
Hide
Director, AI Platform Engineering
San Francisco or Boston or Waltham or New York City
$200k-$230k/yr HybridFull Time
10+ YOE5+ MgmtRequires 10+ years in software engineering, 5+ years in engineering leadership, production platform expertise, AI/ML ecosystem knowledge, cloud infrastructure experience, and Python backend development.
LangGraph, MCP, AG-UI, CrewAI, AutoGen, OpenAI, Anthropic, AWS Bedrock, Kubernetes, Docker, Terraform, Python, FastAPI, SSE, WebSocket, GraphQL, dbt, Module Federation
1w
Save
Mark Applied
Hide
AI Platform Delivery Director
Boston or Springfield or New York City
$148k-$195k/yr HybridFull Time
5+ YOE3+ MgmtRequires 5+ years of software engineering experience, 3+ years managing engineers, cloud-native architecture knowledge, AI/ML infrastructure exposure, a bachelor's degree, and US work authorization without sponsorship.
Kubernetes, AWS, GCP, Azure, Degreed
1mo
Save
Mark Applied
Hide
AI Solutions Architect - Global Financial Services
Hartford or Washington D.C. or Tampa or Atlanta or Boston or Charlotte or Trenton or New York or Philadelphia or Pittsburgh
$185k-$235k/yr OnsiteFull Time
10+ YOE10+ years in technical pre-sales or solutions architecture; bachelor's in CS/engineering; hands-on AI/ML infrastructure experience; NVIDIA and cloud platform knowledge; strong presentation and whiteboarding skills.
NVIDIA DGX/HGX, CUDA, AI Enterprise, NeMo, Omniverse, AWS, Azure, GCP, Dell, HPE, Cisco, NetApp, Pure Storage, Vast Data, Advanced Technology Center (ATC), NVAIE
Explore Jobs