New York City • 50 milesRemote · Hybrid · Onsite · Field · All Environments
New York City • 50 milesRemote · Hybrid · Onsite · Field · All Environments
New York City • 50 milesRemote · Hybrid · Onsite · Field · All Environments
New York City • 50 milesRemote · Hybrid · Onsite · Field · All Environments
43 machine learning infrastructure engineer jobs at 34 companies in New York City, NY
1mo
Save
Mark Applied
Hide
Machine Learning Infrastructure Engineer
San Francisco or New York or Los Angeles or Seattle
$200k-$345k/yr HybridFull Time
4+ YOE4+ years building ML systems,3+ years software engineering,1+ year Python,experience with databases,monitoring,cloud services and production ML deployments.
Python, PostgreSQL, DynamoDB, Elasticsearch, Redis, DataDog, Grafana, AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS, ECS, Apache Kafka, Flink
2w
Save
Mark Applied
Hide
Machine Learning Infrastructure Engineer, Technology
New York City, New York, United States
$185k-$300k/yr OnsiteFull Time
3+ YOEBachelor’s or master’s degree in a technical field; 3–7 years building scalable compute or ML infrastructure; expertise in distributed systems, Kubernetes, cloud platforms, MLOps, Python, and systems programming.
Kubernetes, AWS, Google Cloud Platform, Azure, MLflow, Ray, Airflow, Kubeflow, Terraform, Python, Go, C++, Rust
1mo
Save
Mark Applied
Hide
Machine Learning Infrastructure Engineer, Safeguards Research
San Francisco or New York City
$350k-$500k/yr HybridFull Time
Proven software engineering with Python, experience building and operating data-intensive or distributed systems, tooling for researcher workflows, debugging performance and correctness, and strong communication skills.
Python, transformers, GPU
1w
Save
Mark Applied
Hide
Senior Machine Learning Engineer, Infrastructure
New York City or San Francisco
$212k-$318k/yr HybridFull Time
Deep experience building production ML infrastructure, low-latency inference pipelines, feature stores, distributed systems, backend engineering, Python, debugging, documentation, and code reviews.
Python
2d
Save
Mark Applied
Hide
Sr Staff Machine Learning Engineer - Media Intelligence
San Jose or San Francisco or Seattle or New York City
$190k-$346k/yr OnsiteFull Time
10+ YOE10+ years in machine learning, data, or infrastructure engineering; expertise in large-scale search and retrieval, data pipelines, RAG, observability, cloud platforms, and technical leadership. MS or PhD preferred.
HNSW, IVF, ScaNN, DiskANN, Lucene, Elasticsearch, OpenSearch, Spark, Beam, Flink, Ray, PyTorch, Docker, Kubernetes, CI/CD, AWS, Azure, Go, Rust, C++, Python
2w
Save
Mark Applied
Hide
Senior Engineer - Machine Learning
Midvale or New York City
HybridFull Time
6+ YOE6+ years of Python-focused software development; machine learning and generative AI systems; AI agents and evaluation harnesses; cloud infrastructure, MLOps, unstructured data, Agile, and CI/CD.
Python, React, JavaScript, MLOps, CI/CD
3w
Save
Mark Applied
Hide
Machine Learning Engineer
New York City, New York, United States
$300k/yr OnsiteFull Time
Experienced ML engineer with strong math foundation, production training/inference infrastructure experience, reproducible research codebases, and expertise in ML frameworks.
PyTorch, Jax, TensorFlow
1mo
Save
Mark Applied
Hide
Staff Machine Learning Engineer - AI Cloud
San Francisco or New York or Seattle
$198k-$330k/yr OnsiteFull Time
8+ YOE8+ years software engineering experience with 5+ years focused on ML; deep expertise in LLMs and modern ML; hands-on with PyTorch and JAX; experience shipping ML systems and building evaluation/production infrastructure.
PyTorch, JAX, Slack, Microsoft 365
1mo
Save
Mark Applied
Hide
Machine Learning Engineer
New York City, New York, United States
$180k-$230k/yr OnsiteFull Time
Experience building production ML or data infrastructure at scale; strong Python skills; experience with Spark/Databricks, model training pipelines and low-latency serving; ownership of SLAs, monitoring, and on-call; interest in applied modeling.
Python, Spark, Databricks, MLflow
1w
Save
Mark Applied
Hide
Principal Machine Learning Engineer
Glendale or New York City
$207k-$278k/yr HybridFull Time
10+ YOEBachelor's degree or equivalent experience, 10+ years building production ML systems, expertise in data science, deep learning, distributed systems, cloud infrastructure, big data, architecture, incident response, and technical leadership.
REST, AWS, AWS Step Functions, AWS Lambda, AWS Glue, Amazon SQS, Amazon SNS, Amazon Personalize, Databricks, Spark, Kinesis, Kafka, LangGraph, AutoGen, CrewAI, Claude, Cursor, GitHub Copilot, MLflow, Amazon SageMaker, Vertex AI
1w
Save
Mark Applied
Hide
Principal Machine Learning Engineer
Glendale or New York City
$207k-$278k/yr HybridFull Time
10+ YOEBachelor’s degree or equivalent experience, 10+ years building production ML systems, architecture ownership, deep learning and data expertise, distributed systems, cloud infrastructure, big data, incident leadership, and senior stakeholder communication.
Amazon Web Services (AWS), AWS Step Functions, AWS Lambda, AWS Glue, Amazon SQS, Amazon SNS, Amazon Personalize, Databricks, Apache Spark, Amazon Kinesis, Apache Kafka, REST, LangGraph, AutoGen, CrewAI, Claude, Cursor, GitHub Copilot, MLflow, Amazon SageMaker, Vertex AI, Agile, Scrum
2mo
Save
Mark Applied
Hide
Senior Machine Learning Platform Engineer
New York, New York, United States
$155k-$215k/yr HybridFull Time
6+ YOE6+ years software engineering (2+ years ML infrastructure); strong Python; experience with cloud ML services (AWS SageMaker, GCP Vertex AI), Terraform/Pulumi, Kubernetes/ECS, GPU inference, observability, and CI/CD for ML.
Python, AWS SageMaker, GCP Vertex AI, Terraform, Pulumi, Kubernetes, ECS, Go, Rust, C++
2mo
Save
Mark Applied
Hide
Senior Machine Learning Platform Engineer
New York, New York, United States
$170k-$220k/yr HybridFull Time
4+ YOE4+ years software engineering experience (2+ years in ML infrastructure/platform); strong Python; experience with cloud ML services, CI/CD for ML, IaC (Terraform/Pulumi), and container orchestration (Kubernetes/ECS); GPU inference and LLM observability experience a plus.
Python, AWS SageMaker, GCP Vertex AI, Terraform, Pulumi, Kubernetes, ECS, Go, Rust, C++
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer, Agent Oversight
San Francisco or New York City
$216k-$270k/yr OnsiteFull Time
5+ YOE5+ years as an ML engineer or applied scientist with production ML/LLM systems; experience building evaluation/monitoring or continuous-learning infrastructure; strong experimentation and collaboration skills.
LLMs, RLHF, SFT
4w
Save
Mark Applied
Hide
Machine Learning Engineer, Infra, AI for Drug Discovery
South San Francisco or New York City
$148k-$274k/yr OnsiteFull Time
3+ YOEBS/MS or equivalent,3+ years in software/infrastructure/platform/MLOps,strong Python,cloud (AWS) and Kubernetes experience,Terraform/Pulumi,observability tools,distributed-systems knowledge,ability to deliver production software.
Python, EKS, EC2, S3, IAM, SQS, SNS, CloudWatch, Kubernetes, Helm, Terraform, Pulumi, Git, Datadog, Prometheus, Grafana, OpenTelemetry, KServe, Triton, vLLM, Ray Serve, Prefect, Dagster
2mo
Save
Mark Applied
Hide
Machine Learning Engineer 5 - Decisioning & Optimization
New York City or Seattle or Los Angeles or Los Gatos
$466k-$750k/yr OnsiteFull Time
7+ YOE7+ years software engineering experience with 3+ years on ML infrastructure or model serving; proficiency in Java, Python, or Scala; experience building high‑QPS, low‑latency model serving, feature serving, and model monitoring.
Java, Python, Scala, Chronon, Signal Service, JVM
2mo
Save
Mark Applied
Hide
Machine Learning Engineer 5 - Decisioning & Optimization
New York or Los Angeles or Los Gatos or Seattle
$466k-$750k/yr OnsiteFull Time
7+ YOE7+ years software engineering; 3+ years ML infrastructure, model serving, or ML platform experience in ads/real-time decisioning; real-time model serving with sub-20ms latency; proficiency in Java, Python, or Scala; experience with ML serving frameworks and real-time feature pipelines; strong model monitoring and production readiness.
Java, Python, Scala, ML serving frameworks, feature stores, model registries
1w
Save
Mark Applied
Hide
Senior Staff Machine Learning Platform Engineer
United States or San Francisco or Arizona or California or Colorado or Connecticut or District of Columbia or Florida or Georgia or Idaho or Illinois or Indiana or Kentucky or Maine or Maryland or Massachusetts or Michigan or Minnesota or Missouri or Nevada or New Hampshire or New Jersey or New Mexico or New York or North Carolina or Ohio or Oregon or Pennsylvania or Rhode Island or Tennessee or Texas or Utah or Virginia or Washington or Wisconsin or Kitchener or Toronto or London or New York City
$295k-$406k/yr HybridFull Time
10+ YOE10–12 years building large-scale ML or data platforms; degree preferred in a technical field; deep Databricks expertise, distributed systems, ML infrastructure, cloud architecture, and cross-functional technical leadership.
Python, SQL, Kotlin, PyTorch, PySpark, MLflow, Apache Spark, Apache Kafka, Databricks, Snowflake, Fivetran, Iceberg, Unity Catalog, Datadog, Airflow, CockroachDB, MySQL, AWS, Amazon S3, Amazon SageMaker, Kubernetes, Docker, GitHub Actions, Terraform, Claude Sonnet 4.5, ChatGPT 5.2
1mo
Save
Mark Applied
Hide
Principal Software Engineer, Machine Learning Infrastructure
Palo Alto or Seattle or Los Angeles or New York City or Bellevue
$235k-$414k/yr OnsiteFull Time
10+ YOE10+ years software development experience (or equivalent with advanced degree), technical leadership experience, expertise in large-scale distributed systems, RPC services, debugging, performance analysis, and mentorship.
Tensorflow, PyTorch, Kubernetes, GPU
1mo
Save
Mark Applied
Hide
Principal Software Engineer, Machine Learning Infrastructure
Palo Alto or Seattle or Los Angeles or New York or Bellevue
$235k-$414k/yr OnsiteFull Time
10+ YOE10+ years software development experience, technical leadership, distributed systems and ML inference platform expertise, strong software design and debugging skills, ability to operate highly-available systems at scale.
Tensorflow, PyTorch, Kubernetes, GPU, LLM inference, RPC
Explore Jobs
Expand Your Job Search
Top Cities Near New York for Machine Learning Infrastructure Engineer
- Machine Learning Infrastructure Engineer jobs in Brooklyn, NY
- Machine Learning Infrastructure Engineer jobs in Queens, NY
- Machine Learning Infrastructure Engineer jobs in Manhattan, NY
- Machine Learning Infrastructure Engineer jobs in The Bronx, NY
- Machine Learning Infrastructure Engineer jobs in Staten Island, NY
- Machine Learning Infrastructure Engineer jobs in Newark, NJ
- Machine Learning Infrastructure Engineer jobs in Jersey City, NJ
- Machine Learning Infrastructure Engineer jobs in Yonkers, NY
- Machine Learning Infrastructure Engineer jobs in Paterson, NJ
- Machine Learning Infrastructure Engineer jobs in Elizabeth, NJ
- Machine Learning Infrastructure Engineer jobs in Stamford, CT
- Machine Learning Infrastructure Engineer jobs in Edison, NJ
- Machine Learning Infrastructure Engineer jobs in Norwalk, CT
- Machine Learning Infrastructure Engineer jobs in Greenburgh, NY
- Machine Learning Infrastructure Engineer jobs in Clifton, NJ
- Machine Learning Infrastructure Engineer jobs in New Rochelle, NY
- Machine Learning Infrastructure Engineer jobs in Passaic, NJ
- Machine Learning Infrastructure Engineer jobs in Union City, NJ
- Machine Learning Infrastructure Engineer jobs in Mount Vernon, NY
- Machine Learning Infrastructure Engineer jobs in Bayonne, NJ