129 ml infrastructure engineer jobs at 82 companies in Peekskill, NY
2mo
Save
Mark Applied
Hide
Senior ML Infrastructure Engineer
New York City, New York, United States
OnsiteFull Time
3+ YOEBachelor's degree or higher in CS/EE or related field; 3+ years backend infra; expert Python; 2+ years cloud (AWS); design APIs/SDKs; ML workflows.
Python, AWS, IAM, Networking, Cost Management, APIs, SDKs
2mo
Save
Mark Applied
Hide
Senior ML Infrastructure Engineer
New York City, New York, United States
$180k-$230k/yr OnsiteFull Time
5+ YOEExperience building scalable data pipelines; proficiency in Spark, Databricks, SQL, PySpark, Python; strong communication; ownership of end-to-end data systems; healthcare/insurance domain preferred.
Spark, Databricks, SQL, PySpark, Python, Git
5d
Save
Mark Applied
Hide
ML Engineer, Foundation Model Infrastructure
Mountain View or San Francisco or Kirkland or New York City
$175k-$215k/yr HybridFull Time
Master's degree or equivalent practical experience; Python and C++ proficiency; modern deep learning framework familiarity; experience with large-scale data pipelines or ML infrastructure.
Python, C++, Flume, JAX, PyTorch, TensorFlow, Spark, Borg, Kubeflow
1mo
Save
Mark Applied
Hide
Staff ML Engineer - Ads ML Infrastructure
New York City, New York, United States
OnsiteFull Time
Design, develop, and build scalable machine learning platform capabilities for advertising; collaborate with engineers and data scientists in an Agile environment; focus on performance and privacy.
4d
Save
Mark Applied
Hide
Senior Infrastructure Engineer, Research
Singapore or London or New York City or Singapore
HybridFull Time
5+ YOERequires 5+ years building and operating ML infrastructure at scale, distributed training expertise, Linux and networking fundamentals, Kubernetes and SLURM, Python, ML frameworks, and cloud GPU infrastructure experience.
NVIDIA DGX B200, NCCL, FSDP, DDP, Linux, NVLink, InfiniBand, Kubernetes, SLURM, Python, PyTorch, CoreWeave, Weights & Biases, MLflow, Prometheus, Grafana
1mo
Save
Mark Applied
Hide
Senior ML Ops Engineer
New York, New York, United States
$210k-$300k/yr OnsiteFull Time
5+ YOE5+ years building production ML/ML platform systems, strong Python and cloud infrastructure skills, experience with IaC and CI/CD, productionizing models and agentic workloads, and ownership of reliability/observability.
Python, Ruby, Ruby on Rails, AWS, Terraform, Kubernetes, GitHub Actions, Snowflake, Aurora/RDS, Redis, Kafka, vLLM, ONNX, TensorRT, MLflow, BentoML, Ray, Airflow, Bedrock, SageMaker, Vertex AI
8h
Save
Mark Applied
Hide
Senior AI/ML Engineer
New York City, New York, United States
RemoteFull Time
Build inference infrastructure, own model evaluation pipelines, optimize latency, and integrate orchestration engines with frontier large language models.
2mo
Save
Mark Applied
Hide
Infrastructure Engineer
New York or San Francisco or United States
$165k-$200k/yr HybridFull Time
Kubernetes production experience; IaC (Terraform/Helm); cloud (AWS/GCP); Python/Node.js; CI/CD (GitHub Actions/Spacelift); security and ML/AI infrastructure familiarity.
Kubernetes, Terraform, Helm, Python, Node.js, GitHub Actions, Spacelift, AWS, GCP, PyTorch, TensorFlow, Bash
1mo
Save
Mark Applied
Hide
Machine Learning Infrastructure Engineer
San Francisco or New York or Los Angeles or Seattle
$200k-$345k/yr HybridFull Time
4+ YOE4+ years building ML systems,3+ years software engineering,1+ year Python,experience with databases,monitoring,cloud services and production ML deployments.
Python, PostgreSQL, DynamoDB, Elasticsearch, Redis, DataDog, Grafana, AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS, ECS, Apache Kafka, Flink
3mo
Save
Mark Applied
Hide
SWE - Backend Infrastructure Engineer
San Francisco or Bellevue or New York
$175k-$280k/yr OnsiteFull Time
3+ YOEStrong systems thinker with reliability engineering experience; 3+ years in infrastructure, platform, or ML systems; Kubernetes production experience; strong communication.
Kubernetes, Terraform, CloudFormation, Pulumi, TorchServe, Seldon, KServe, Ray Serve, PyTorch, APIs, Database design
13h
Save
Mark Applied
Hide
Software Engineer, ML Platform
Denver or San Francisco or New York City or San Jose or Scottsdale
$160k-$240k/yr HybridFull Time
4+ YOERequires 4+ years of software engineering experience in Python, Ruby, or Java; ML infrastructure and platform-service experience; cloud-platform experience; and familiarity with AI frameworks and AI-assisted development tools.
Python, Ruby, Java, AWS, CI/CD
4w
Save
Mark Applied
Hide
Software Engineer, ML Products
New York City, New York, United States
$175k-$275k/yr OnsiteFull Time
5+ YOE5+ years experience building ML/agentic systems, expertise in context engineering (RAG, token optimization), evaluation systems, and production-quality agent infrastructure.
1mo
Save
Mark Applied
Hide
AI-Enabled Infrastructure and Systems Engineer
New York, New York, United States
$162k-$200k/yr HybridFull Time
5+ YOE5+ years infrastructure engineering experience; cloud (AWS/Azure/GCP) and IaC (Terraform/CloudFormation/ARM/Bicep/Ansible) proficiency; scripting (Python/Java/Golang); experience supporting AI/ML workloads and platform engineering.
Terraform, Ansible, CloudFormation, ARM/Bicep, Python, Java, Golang, AWS, Microsoft Azure ML, Microsoft Azure Foundry, AWS Bedrock, Google Vertex
3mo
Save
Mark Applied
Hide
Software Engineer, AI/ML (Infrastructure & Platform)
New York City or Tempe or San Francisco
$200k-$235k/yr HybridFull Time
Build AI infrastructure and platform software; strong software engineering, distributed systems, production AI experience.
Python, TypeScript, C#, APIs, Distributed Systems, LLM/AI Systems, Tool/Skill Abstractions, LangChain, Data Pipelines
2w
Save
Mark Applied
Hide
Sr Lead Software Engineer - AWS - Lead AI/ML Platform Engineer
Jersey City, New Jersey, United States
$171k-$260k/yr OnsiteFull Time
5+ YOE5+ years software engineering experience, deep AWS and cloud infrastructure knowledge, production platform and architecture experience, strong client communication, and experience with responsible AI and AI-assisted development.
AWS, Kubernetes, EKS, AWS Sagemaker, Golang, Terraform, LLMs
3d
Save
Mark Applied
Hide
Recommendation Architecture AI/ML Infrastructure Engineer Intern (Data-Arch-TikTok Live) - 2027 Summer
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
OnsiteInternship
Pursuing a bachelor's or master's degree in AI, software development, computer science, computer engineering, or related field; strong C++ or Python skills; data structures, algorithms, systems, PyTorch or TensorFlow, and LLM knowledge.
C++, Python, PyTorch, TensorFlow, CUDA, Triton, FSDP, ZeRO, FlashAttention
2mo
Save
Mark Applied
Hide
General Application — Data & AI/ML Engineering
New York or United States
HybridFull Time
4+ YOE4+ years in data or ML engineering, strong Python and SQL, experience with Spark/dbt/Airflow, cloud data infrastructure (AWS/GCP/Azure), ML lifecycle and systems design; Bachelor's/Master's in CS/Engineering preferred.
Python, SQL, Spark, dbt, Airflow, AWS, GCP, Azure, Docker, Kubernetes
10h
Save
Mark Applied
Hide
Lead ML Engineer
Englewood Cliffs, New Jersey, United States
$190k-$210k/yr HybridFull Time
8+ YOERequires 8–12+ years in machine learning, applied AI, and distributed systems; production ML experience; Python, ML frameworks, cloud infrastructure, LLMs, retrieval systems, and cross-functional leadership.
Python, AWS, GCP, Azure
2mo
Save
Mark Applied
Hide
Software Engineer, ML Data Infrastructure
Toronto or New York City
OnsiteFull Time
2+ YOE2+ years building large-scale distributed systems, strong fundamentals in data structures, algorithms, databases, and large-scale data processing; experience with Python, Kubernetes, GCP, and related data infra is helpful.
Python, Kubernetes, GCP, Google Bigtable, Google BigQuery, Google Spanner, Google Pub/Sub, Docker, Terraform, TPU infrastructure
1mo
Save
Mark Applied
Hide
Engineering Manager, ML
San Francisco or New York
OnsiteFull Time
Lead engineers building ML training, evaluation, and rollout infrastructure; strong distributed systems and infrastructure experience; hiring and developing engineers; able to collaborate with researchers and stay technical.
Cursor
Explore Jobs