37 ml infrastructure engineer jobs at 26 companies in Rye, NH
2mo
Save
Mark Applied
Hide
Staff Machine Learning Engineer, ML Infrastructure
Boston, Massachusetts, United States
$184k-$269k/yr HybridFull Time
8+ YOE8+ years software/ML engineering; deep cloud ML infra on Kubernetes; Ray experience; AWS and Kafka; Python; staff-level technical leadership.
Ray, Kubernetes, KServe, Triton, vLLM, Kubeflow, Argo, AWS (EKS, S3, IAM), Kafka, CI/CD, infrastructure-as-code, Python, Go/C++/Rust (bonus)
2mo
Save
Mark Applied
Hide
Data Infrastructure & ML Engineer (Hybrid Role)
Beverly, Massachusetts, United States
$122k-$183k/yr HybridFull Time
5+ YOEBachelor's or Master's in CS/Engineering, 5+ years experience building ETL/ELT data pipelines, strong Python and SQL skills, database design and distributed systems experience, familiarity with JSON/logs, data traceability, validation, and governance.
Python, Pandas, NumPy, Plotly, Kafka, Azure, AWS, GCP, SQL, JSON
1w
Save
Mark Applied
Hide
Staff Research Engineer, Scientific Computing and ML/Physics Infrastructure
Cambridge or London or San Francisco
$224k-$294k/yr OnsiteFull Time
Strong software engineering in Python, experience with ML/scientific computing, distributed systems, GPU performance, PyTorch/JAX/CUDA, Linux and containers, orchestration systems, and working with research teams.
Python, PyTorch, JAX, CUDA, Linux, Docker, Kubernetes, Slurm, Ray, Flyte, Argo, CI
1w
Save
Mark Applied
Hide
Member of Technical Staff, ML Engineer
Boston, Massachusetts, United States
OnsiteFull Time
3+ YOE3+ years building and operating ML training or inference infrastructure; distributed training and model-serving experience; strong software engineering and ML fluency to debug training and inference; cloud and IaC experience preferred.
PyTorch, Ray, vLLM, SGLang, Triton, CUDA, GCP, AWS, Terraform
1mo
Save
Mark Applied
Hide
Principal Engineer, Data Infrastructure
Boston, Massachusetts, United States
$244k-$366k/yr OnsiteFull Time
10+ YOE10+ years building and operating distributed data systems; expertise in ingestion/CDC, stream processing, batch orchestration, lakehouse patterns, governance, SLOs, and applying AI/ML to data platforms.
Kafka, PubSub, Flink, Spark, Beam, Airflow, Dagster, Iceberg, Delta, Hudi, Snowflake, BigQuery, object storage
4w
Save
Mark Applied
Hide
Member of Technical Staff – Senior Engineer, Data Infrastructure & Data Operations
San Francisco or Cambridge
$255k-$340k/yr OnsiteFull Time
Experience building production data infrastructure and high-throughput pipelines, cloud-based data platform development, platform reliability and cost ownership, and collaboration with ML teams.
2w
Save
Mark Applied
Hide
Global AI/ML Engineer Senior Manager
Boston or Atlanta
$173k-$211k/yr OnsiteFull Time
10+ YOEBachelor in CS/Engineering or related; 10+ years software/IT experience; Proven AI-driven application and SaaS implementation; frontend/backend development; cloud and infrastructure-as-code; DevOps and CI/CD experience.
React, Python, Java, Typescript, AWS, Kubernetes, Terraform, pgvector, chromadb, Helm, Neo4J, GraphQL, Jenkins, RDS, Batch, Lambda, Fargate, Step Functions, SQS, SNS, FastAPI, NextJS, Websockets, RabbitMQ, Kafka
1w
Save
Mark Applied
Hide
Senior Developer Relations Engineer, GKE and AI Infrastructure
Sunnyvale or Cambridge or Kirkland or New York City or Raleigh or Durham or Seattle
$163k-$236k/yr OnsiteFull Time
5+ YOEBachelor's in CS or equivalent,5+ years technical experience,2+ years running AI/ML workloads on GPUs/TPUs with Kubernetes/GKE,2+ years producing developer content,proficiency in Python and strong programming skills.
Kubernetes, GKE, GPU, TPU, Python, C++, Java, Vertex AI, Google Cloud
3mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Cambridge or Richmond or McLean or New York or San Jose or San Francisco
$286k-$392k/yr RemoteFull Time
10+ YOE10+ years AI/ML engineering; Python/Go/Scala/Java; distributed compute; CPU/GPU infrastructure; ML/AI workloads.
Python, Go, Scala, Java, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda
2mo
Save
Mark Applied
Hide
Senior Engineering Manager, ML Platform
Waltham, Massachusetts, United States
$198k-$300k/yr OnsiteFull Time
7+ YOE2+ Mgmt7+ years engineering experience with 2+ years management; experience building/scaling ML/platform/infrastructure teams; expertise in GPU/distributed compute, large-scale data storage, and pipeline frameworks; hands-on coding and strong cross-functional communication.
Kubernetes, Slurm, Ray, GPU, TPU
2w
Save
Mark Applied
Hide
AI Platform Engineer
Boston or Springfield or New York City
$164k-$215k/yr HybridFull Time
5+ YOE5+ years platform/infrastructure/SRE experience, cloud-native Kubernetes expertise, CKA/CKAD or AWS certifications, IaC/GitOps experience, AI/ML infrastructure and platform ownership from design to production.
Kubernetes, Terraform, Pulumi, ArgoCD, vLLM, Triton, Ray Serve, AWS, GCP, Azure, Degreed
2mo
Save
Mark Applied
Hide
Principal Engineer
Cambridge, Massachusetts, United States
$188k-$259k/yr OnsiteFull Time
Senior individual-contributor software engineer experienced owning production ML/AI systems, designing distributed system architecture, deploying data infrastructure, and partnering with scientists and ML researchers.
Claude Code, Greenhouse
1mo
Save
Mark Applied
Hide
Lead AI Engineer
Boston, Massachusetts, United States
$150k-$190k/yr HybridFull Time
7+ YOE7+ years in software/ML engineering with expertise in LLMs, RAG, AI Agents, production ML systems, Python/SQL, cloud infrastructure, and leadership on cross-functional initiatives.
Python, SQL, OpenAI, Anthropic, Gemini, Mistral, LangGraph, LangChain, LlamaIndex, MCP, Vector Databases, AWS, GCP, Docker, Kubernetes
4w
Save
Mark Applied
Hide
Software Engineer II, MLOps
Boston, Massachusetts, United States
$125k-$175k/yr OnsiteFull Time
2+ YOE2+ years software engineering experience with ML infrastructure in cloud environments; degree or equivalent; experience with Python or Java; familiarity with ML lifecycle and cloud design patterns; strong collaboration and problem-solving skills.
AWS SageMaker, Lambda, ECS, Python, Java
2mo
Save
Mark Applied
Hide
Sr. Software Engineer II (DevOps)
Boston, Massachusetts, United States
$119k-$221k/yr HybridFull Time
6+ YOE6+ years DevOps/SRE/platform engineering; 2+ years AI/ML infrastructure; Bachelor’s in CS/Engineering or equivalent; deep AWS, Terraform, observability, and Python/Go/TypeScript skills.
AWS, ECS, EKS, Lambda, SageMaker, Bedrock, S3, DynamoDB, Redshift, Terraform, Datadog, CloudWatch, Airflow, dbt, Dagster, Python, Go, TypeScript
2mo
Save
Mark Applied
Hide
Machine Learning Engineer, Apple Store Online
Cambridge, Massachusetts, United States
OnsiteFull Time
Research and develop ML algorithms and models for product search, recommendations, personalization, generative AI, and optimize online retail systems and infrastructure.
2mo
Save
Mark Applied
Hide
Principal Security Engineer
Cambridge or United States
$132k-$238k/yr HybridFull Time
8+ YOE8+ years relevant experience, Bachelor's or equivalent in Computer Science/Security, deep application/infrastructure/cloud-native security expertise, AI/ML security experience, experience defining security architecture and threat models, proficiency in Python or Go, compliance experience.
Python, Go, Kubernetes
1mo
Save
Mark Applied
Hide
Director AI Engineering Platform
United States or Southfield or San Francisco or Seattle or Boston or New York City or Los Angeles or San Diego
$218k-$319k/yr RemoteFull Time
12+ YOE5+ MgmtBS in CS/Engineering (MS preferred), 12+ years software engineering experience with platform/infrastructure focus, 5+ years managing managers, experience delivering enterprise-scale platform capabilities and partnering with AI/ML orgs.
AWS, Microsoft, Databricks, LiteLLM, Portkey, Traefik AI Gateway, MCP, Expressway, LLM APIs, CI/CD, FinOps, AI gateway
1mo
Save
Mark Applied
Hide
Technical Lead Manager, MLOps
New York City or United States or Philadelphia or Boston
$199k-$241k/yr HybridFull Time
6+ YOEBachelor's degree plus 6+ years (or Master's plus 4+ years) in ML engineering; experience building ML platforms, training/serving infrastructure, feature stores, orchestration, monitoring, deployment pipelines; experience managing ML Platform/ML Ops teams; hands-on with Ray, Flink, Feast; cloud data tooling (AWS, Redshift, Databricks, Snowflake); s...
Ray, Flink, Feast, AWS, Redshift, Databricks, Snowflake, Python
1mo
Save
Mark Applied
Hide
AI Solutions Architect - East Region
Hartford or Washington or Tampa or Atlanta or Boston or Charlotte or Trenton or New York or Philadelphia or Pittsburgh
$185k-$235k/yr OnsiteFull Time
10+ YOESenior technical pre-sales architect with 10+ years of experience designing AI/ML infrastructure and platforms, hands-on NVIDIA and cloud experience, strong presentation and whiteboarding skills, and a bachelor’s degree in computer science, engineering, or related field.
NVIDIA DGX, NVIDIA HGX, CUDA, NVIDIA AI Enterprise (NVAIE), NeMo, Omniverse, AWS, Microsoft Azure, GCP, Dell, HPE, Cisco, NetApp, Pure Storage, Vast Data, Advanced Technology Center (ATC), MLOps
Explore Jobs