116 ml infrastructure engineer jobs at 77 companies in Valhalla, NY
2mo
Save
Mark Applied
Hide
Senior ML Infrastructure Engineer
New York City, New York, United States
OnsiteFull Time
3+ YOEBachelor's degree or higher in CS/EE or related field; 3+ years backend infra; expert Python; 2+ years cloud (AWS); design APIs/SDKs; ML workflows.
Python, AWS, IAM, Networking, Cost Management, APIs, SDKs
2mo
Save
Mark Applied
Hide
Senior ML Infrastructure Engineer
New York City, New York, United States
$180k-$230k/yr OnsiteFull Time
5+ YOEExperience building scalable data pipelines; proficiency in Spark, Databricks, SQL, PySpark, Python; strong communication; ownership of end-to-end data systems; healthcare/insurance domain preferred.
Spark, Databricks, SQL, PySpark, Python, Git
1d
Save
Mark Applied
Hide
ML Engineer, Foundation Model Infrastructure
Mountain View or San Francisco or Kirkland or New York City
$175k-$215k/yr HybridFull Time
Master's degree or equivalent practical experience; Python and C++ proficiency; modern deep learning framework familiarity; experience with large-scale data pipelines or ML infrastructure.
Python, C++, Flume, JAX, PyTorch, TensorFlow, Spark, Borg, Kubeflow
3w
Save
Mark Applied
Hide
Principal ML Engineer
New York, New York, United States
$200k-$250k/yr HybridFull Time
8+ YOE8+ years software engineering experience with 4+ years building ML/LLM infrastructure, hands-on PyTorch and LLM stack, production model serving, strong Python and cloud skills.
PyTorch, LoRA, SFT, vLLM, TensorRT-LLM, Python, CI/CD
1mo
Save
Mark Applied
Hide
Staff ML Engineer - Ads ML Infrastructure
New York City, New York, United States
OnsiteFull Time
Design, develop, and build scalable machine learning platform capabilities for advertising; collaborate with engineers and data scientists in an Agile environment; focus on performance and privacy.
16h
Save
Mark Applied
Hide
Senior Infrastructure Engineer, Research
Singapore or London or New York City or Singapore
HybridFull Time
5+ YOERequires 5+ years building and operating ML infrastructure at scale, distributed training expertise, Linux and networking fundamentals, Kubernetes and SLURM, Python, ML frameworks, and cloud GPU infrastructure experience.
NVIDIA DGX B200, NCCL, FSDP, DDP, Linux, NVLink, InfiniBand, Kubernetes, SLURM, Python, PyTorch, CoreWeave, Weights & Biases, MLflow, Prometheus, Grafana
1mo
Save
Mark Applied
Hide
Senior ML Ops Engineer
New York, New York, United States
$210k-$300k/yr OnsiteFull Time
5+ YOE5+ years building production ML/ML platform systems, strong Python and cloud infrastructure skills, experience with IaC and CI/CD, productionizing models and agentic workloads, and ownership of reliability/observability.
Python, Ruby, Ruby on Rails, AWS, Terraform, Kubernetes, GitHub Actions, Snowflake, Aurora/RDS, Redis, Kafka, vLLM, ONNX, TensorRT, MLflow, BentoML, Ray, Airflow, Bedrock, SageMaker, Vertex AI
2mo
Save
Mark Applied
Hide
Infrastructure Engineer
New York or San Francisco or United States
$165k-$200k/yr HybridFull Time
Kubernetes production experience; IaC (Terraform/Helm); cloud (AWS/GCP); Python/Node.js; CI/CD (GitHub Actions/Spacelift); security and ML/AI infrastructure familiarity.
Kubernetes, Terraform, Helm, Python, Node.js, GitHub Actions, Spacelift, AWS, GCP, PyTorch, TensorFlow, Bash
4w
Save
Mark Applied
Hide
Machine Learning Infrastructure Engineer
San Francisco or New York or Los Angeles or Seattle
$200k-$345k/yr HybridFull Time
4+ YOE4+ years building ML systems,3+ years software engineering,1+ year Python,experience with databases,monitoring,cloud services and production ML deployments.
Python, PostgreSQL, DynamoDB, Elasticsearch, Redis, DataDog, Grafana, AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS, ECS, Apache Kafka, Flink
3mo
Save
Mark Applied
Hide
SWE - Backend Infrastructure Engineer
San Francisco or Bellevue or New York
$175k-$280k/yr OnsiteFull Time
3+ YOEStrong systems thinker with reliability engineering experience; 3+ years in infrastructure, platform, or ML systems; Kubernetes production experience; strong communication.
Kubernetes, Terraform, CloudFormation, Pulumi, TorchServe, Seldon, KServe, Ray Serve, PyTorch, APIs, Database design
3w
Save
Mark Applied
Hide
Software Engineer, ML Products
New York City, New York, United States
$175k-$275k/yr OnsiteFull Time
5+ YOE5+ years experience building ML/agentic systems, expertise in context engineering (RAG, token optimization), evaluation systems, and production-quality agent infrastructure.
1mo
Save
Mark Applied
Hide
AI-Enabled Infrastructure and Systems Engineer
New York, New York, United States
$162k-$200k/yr HybridFull Time
5+ YOE5+ years infrastructure engineering experience; cloud (AWS/Azure/GCP) and IaC (Terraform/CloudFormation/ARM/Bicep/Ansible) proficiency; scripting (Python/Java/Golang); experience supporting AI/ML workloads and platform engineering.
Terraform, Ansible, CloudFormation, ARM/Bicep, Python, Java, Golang, AWS, Microsoft Azure ML, Microsoft Azure Foundry, AWS Bedrock, Google Vertex
2mo
Save
Mark Applied
Hide
Software Engineer, AI/ML (Infrastructure & Platform)
New York City or Tempe or San Francisco
$200k-$235k/yr HybridFull Time
Build AI infrastructure and platform software; strong software engineering, distributed systems, production AI experience.
Python, TypeScript, C#, APIs, Distributed Systems, LLM/AI Systems, Tool/Skill Abstractions, LangChain, Data Pipelines
2w
Save
Mark Applied
Hide
Sr Lead Software Engineer - AWS - Lead AI/ML Platform Engineer
Jersey City, New Jersey, United States
$171k-$260k/yr OnsiteFull Time
5+ YOE5+ years software engineering experience, deep AWS and cloud infrastructure knowledge, production platform and architecture experience, strong client communication, and experience with responsible AI and AI-assisted development.
AWS, Kubernetes, EKS, AWS Sagemaker, Golang, Terraform, LLMs
2mo
Save
Mark Applied
Hide
General Application — Data & AI/ML Engineering
New York or United States
HybridFull Time
4+ YOE4+ years in data or ML engineering, strong Python and SQL, experience with Spark/dbt/Airflow, cloud data infrastructure (AWS/GCP/Azure), ML lifecycle and systems design; Bachelor's/Master's in CS/Engineering preferred.
Python, SQL, Spark, dbt, Airflow, AWS, GCP, Azure, Docker, Kubernetes
2mo
Save
Mark Applied
Hide
Software Engineer, ML Data Infrastructure
Toronto or New York City
OnsiteFull Time
2+ YOE2+ years building large-scale distributed systems, strong fundamentals in data structures, algorithms, databases, and large-scale data processing; experience with Python, Kubernetes, GCP, and related data infra is helpful.
Python, Kubernetes, GCP, Google Bigtable, Google BigQuery, Google Spanner, Google Pub/Sub, Docker, Terraform, TPU infrastructure
1w
Save
Mark Applied
Hide
Senior Backend Engineer (ML)
New York City, New York, United States
$200k-$230k/yr HybridFull Time
4+ YOE4+ years building production distributed systems or data infrastructure; strong backend fundamentals; proficiency in Python and TypeScript; hands-on AWS and PostgreSQL experience; observability and incident response skills.
Python, TypeScript, AWS, PostgreSQL, vLLM, SGLang, TensorRT, k8s
4w
Save
Mark Applied
Hide
Engineering Manager, ML
San Francisco or New York
OnsiteFull Time
Lead engineers building ML training, evaluation, and rollout infrastructure; strong distributed systems and infrastructure experience; hiring and developing engineers; able to collaborate with researchers and stay technical.
Cursor
6d
Save
Mark Applied
Hide
Staff Software Engineer - Data Cloud Applied ML
San Francisco or Seattle or New York City
$189k-$315k/yr OnsiteFull Time
8+ YOE8+ years engineering experience owning distributed systems, experience deploying and optimizing LLMs, backend skills in Python/Go/Java, and cloud-native infrastructure experience (Kubernetes).
Python, Go, Java, Kubernetes, LLMs
1w
Save
Mark Applied
Hide
Associate Manager, Production AI/ML Engineering, Advanced Informatics
Tarrytown or Armonk or Warren
$110k-$179k/yr OnsiteFull Time
7+ YOEBachelor's (Master's preferred) and 7+ years building and operating enterprise ML/platform infrastructure on AWS; Kubernetes, Python, SQL, API, Postgres, MLOps tooling, and informatics experience preferred.
Kubernetes, AWS, SageMaker, ECS, EC2, S3, Lambda, SNOMED CT, ICD-10, ICD-11, LOINC, RxNorm, OMOP CDM, RESTful APIs, Postgres, Python, SQL, Git, MLflow, W&B, Docker, Airflow, Prefect
Explore Jobs