42 ml infrastructure engineer jobs at 29 companies in Walpole, MA
2mo
Save
Mark Applied
Hide
Staff Machine Learning Engineer, ML Infrastructure
Boston, Massachusetts, United States
$184k-$269k/yr HybridFull Time
8+ YOE8+ years software/ML engineering; deep cloud ML infra on Kubernetes; Ray experience; AWS and Kafka; Python; staff-level technical leadership.
Ray, Kubernetes, KServe, Triton, vLLM, Kubeflow, Argo, AWS (EKS, S3, IAM), Kafka, CI/CD, infrastructure-as-code, Python, Go/C++/Rust (bonus)
2mo
Save
Mark Applied
Hide
Data Infrastructure & ML Engineer (Hybrid Role)
Beverly, Massachusetts, United States
$122k-$183k/yr HybridFull Time
5+ YOEBachelor's or Master's in CS/Engineering, 5+ years experience building ETL/ELT data pipelines, strong Python and SQL skills, database design and distributed systems experience, familiarity with JSON/logs, data traceability, validation, and governance.
Python, Pandas, NumPy, Plotly, Kafka, Azure, AWS, GCP, SQL, JSON
1w
Save
Mark Applied
Hide
Staff Research Engineer, Scientific Computing and ML/Physics Infrastructure
Cambridge or London or San Francisco
$224k-$294k/yr OnsiteFull Time
Strong software engineering in Python, experience with ML/scientific computing, distributed systems, GPU performance, PyTorch/JAX/CUDA, Linux and containers, orchestration systems, and working with research teams.
Python, PyTorch, JAX, CUDA, Linux, Docker, Kubernetes, Slurm, Ray, Flyte, Argo, CI
1w
Save
Mark Applied
Hide
Member of Technical Staff, ML Engineer
Boston, Massachusetts, United States
OnsiteFull Time
3+ YOE3+ years building and operating ML training or inference infrastructure; distributed training and model-serving experience; strong software engineering and ML fluency to debug training and inference; cloud and IaC experience preferred.
PyTorch, Ray, vLLM, SGLang, Triton, CUDA, GCP, AWS, Terraform
1mo
Save
Mark Applied
Hide
Principal Engineer, Data Infrastructure
Boston, Massachusetts, United States
$244k-$366k/yr OnsiteFull Time
10+ YOE10+ years building and operating distributed data systems; expertise in ingestion/CDC, stream processing, batch orchestration, lakehouse patterns, governance, SLOs, and applying AI/ML to data platforms.
Kafka, PubSub, Flink, Spark, Beam, Airflow, Dagster, Iceberg, Delta, Hudi, Snowflake, BigQuery, object storage
4w
Save
Mark Applied
Hide
Member of Technical Staff – Senior Engineer, Data Infrastructure & Data Operations
San Francisco or Cambridge
$255k-$340k/yr OnsiteFull Time
Experience building production data infrastructure and high-throughput pipelines, cloud-based data platform development, platform reliability and cost ownership, and collaboration with ML teams.
2w
Save
Mark Applied
Hide
Global AI/ML Engineer Senior Manager
Boston or Atlanta
$173k-$211k/yr OnsiteFull Time
10+ YOEBachelor in CS/Engineering or related; 10+ years software/IT experience; Proven AI-driven application and SaaS implementation; frontend/backend development; cloud and infrastructure-as-code; DevOps and CI/CD experience.
React, Python, Java, Typescript, AWS, Kubernetes, Terraform, pgvector, chromadb, Helm, Neo4J, GraphQL, Jenkins, RDS, Batch, Lambda, Fargate, Step Functions, SQS, SNS, FastAPI, NextJS, Websockets, RabbitMQ, Kafka
3mo
Save
Mark Applied
Hide
Senior AI Infrastructure Platform Engineer, Assistant Vice President
Quincy or Austin
$90k-$158k/yr OnsiteFull Time
5+ YOELead GenAI/Agentic AI projects; strong full-stack development and architecture; collaboration with business and IT; experience with cloud and AI/ML tools.
Python, FastAPI, Unix, Docker, PostgreSQL, Lang Chain, Kubernetes, Databricks, API Management, AWS, Azure, OpenAI
3mo
Save
Mark Applied
Hide
Senior AI Infrastructure Platform Engineer, Assistant Vice President
Quincy or Austin
$90k-$158k/yr HybridFull Time
5+ YOELead/architect AI automation platforms; hands-on development with AI/ML, cloud, and DevOps; senior engineer capable of driving projects and collaborating with cross-functional teams.
Python, FastAPI, Unix, Docker, Postgres, Lang Chain, Lang Graph, Kubernetes, Databricks, API Management, AWS, Azure, OpenAI, Azure Foundry, Sagemaker, Lambda, EKS
1w
Save
Mark Applied
Hide
Senior Developer Relations Engineer, GKE and AI Infrastructure
Sunnyvale or Cambridge or Kirkland or New York City or Raleigh or Durham or Seattle
$163k-$236k/yr OnsiteFull Time
5+ YOEBachelor's in CS or equivalent,5+ years technical experience,2+ years running AI/ML workloads on GPUs/TPUs with Kubernetes/GKE,2+ years producing developer content,proficiency in Python and strong programming skills.
Kubernetes, GKE, GPU, TPU, Python, C++, Java, Vertex AI, Google Cloud
2w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
3mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Cambridge or Richmond or McLean or New York or San Jose or San Francisco
$286k-$392k/yr RemoteFull Time
10+ YOE10+ years AI/ML engineering; Python/Go/Scala/Java; distributed compute; CPU/GPU infrastructure; ML/AI workloads.
Python, Go, Scala, Java, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda
2mo
Save
Mark Applied
Hide
Senior Engineering Manager, ML Platform
Waltham, Massachusetts, United States
$198k-$300k/yr OnsiteFull Time
7+ YOE2+ Mgmt7+ years engineering experience with 2+ years management; experience building/scaling ML/platform/infrastructure teams; expertise in GPU/distributed compute, large-scale data storage, and pipeline frameworks; hands-on coding and strong cross-functional communication.
Kubernetes, Slurm, Ray, GPU, TPU
2w
Save
Mark Applied
Hide
AI Platform Engineer
Boston or Springfield or New York City
$164k-$215k/yr HybridFull Time
5+ YOE5+ years platform/infrastructure/SRE experience, cloud-native Kubernetes expertise, CKA/CKAD or AWS certifications, IaC/GitOps experience, AI/ML infrastructure and platform ownership from design to production.
Kubernetes, Terraform, Pulumi, ArgoCD, vLLM, Triton, Ray Serve, AWS, GCP, Azure, Degreed
2mo
Save
Mark Applied
Hide
Principal Engineer
Cambridge, Massachusetts, United States
$188k-$259k/yr OnsiteFull Time
Senior individual-contributor software engineer experienced owning production ML/AI systems, designing distributed system architecture, deploying data infrastructure, and partnering with scientists and ML researchers.
Claude Code, Greenhouse
1mo
Save
Mark Applied
Hide
Lead AI Engineer
Boston, Massachusetts, United States
$150k-$190k/yr HybridFull Time
7+ YOE7+ years in software/ML engineering with expertise in LLMs, RAG, AI Agents, production ML systems, Python/SQL, cloud infrastructure, and leadership on cross-functional initiatives.
Python, SQL, OpenAI, Anthropic, Gemini, Mistral, LangGraph, LangChain, LlamaIndex, MCP, Vector Databases, AWS, GCP, Docker, Kubernetes
4w
Save
Mark Applied
Hide
Software Engineer II, MLOps
Boston, Massachusetts, United States
$125k-$175k/yr OnsiteFull Time
2+ YOE2+ years software engineering experience with ML infrastructure in cloud environments; degree or equivalent; experience with Python or Java; familiarity with ML lifecycle and cloud design patterns; strong collaboration and problem-solving skills.
AWS SageMaker, Lambda, ECS, Python, Java
2mo
Save
Mark Applied
Hide
Sr. Software Engineer II (DevOps)
Boston, Massachusetts, United States
$119k-$221k/yr HybridFull Time
6+ YOE6+ years DevOps/SRE/platform engineering; 2+ years AI/ML infrastructure; Bachelor’s in CS/Engineering or equivalent; deep AWS, Terraform, observability, and Python/Go/TypeScript skills.
AWS, ECS, EKS, Lambda, SageMaker, Bedrock, S3, DynamoDB, Redshift, Terraform, Datadog, CloudWatch, Airflow, dbt, Dagster, Python, Go, TypeScript
2w
Save
Mark Applied
Hide
Senior Medical Device Software Engineer
Newton, Massachusetts, United States
OnsiteFull Time
2+ YOE2+ years production software engineering; experience in robotics, computer vision/ML, or systems/infrastructure; comfortable with Python,C++,Linux,GIT; ability to work in high-reliability regulated environments.
Python, C++, Linux, GIT, CI/CD, Drake, ROS, Moveit, RVIZ, Gazebo, Isaac Sim, QNX
2mo
Save
Mark Applied
Hide
Machine Learning Engineer, Apple Store Online
Cambridge, Massachusetts, United States
OnsiteFull Time
Research and develop ML algorithms and models for product search, recommendations, personalization, generative AI, and optimize online retail systems and infrastructure.
Explore Jobs