HiringCafe
Join our community

119 ml infrastructure engineer jobs at 79 companies in Wayne, NJ

PromotedHiringCafe
ML Engineer - Inference & Model Deployment
Cupertino, CA, US
$250k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Turn powerful AI and ML models into fast, reliable production systems. Own inference latency, throughput, model-serving architecture, multi-GPU systems, and production deployment for millions of users.
Python, PyTorch, vLLM, SGLang, TensorRT, LLMs
Help us #BeatIndeed & #BeatLinkedIn
PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
PromotedHiringCafe
Founding Backend / Infra Engineer
Cupertino, CA, US
$160k-$300k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Own the crawlers, pipelines, and infrastructure powering a real-time job search engine. Strong Node.js and Python fundamentals; bonus points for security and reverse-engineering chops.
Node.js, Python, Elasticsearch, Redis
Help us #BeatIndeed & #BeatLinkedIn
3mo
Save
Mark Applied
Hide
ML Infrastructure/Platform Engineer
New York City, New York, United States
$140k-$200k/yr HybridFull Time
Anthelion Capital
Anthelion Capital: AI-powered investment firm specializing in private credit and data science.
3+ YOE3+ years in data engineering or ML infrastructure; Python and SQL; orchestration tools (Prefect/Airflow/Dagster); Docker/Kubernetes; cloud (Azure preferred); model serving; monitoring; strong documentation.
Python, SQL, Prefect, Airflow, Dagster, Docker, Kubernetes, Azure, MLflow, LangChain, Snowflake, dbt
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior ML Infrastructure Engineer
New York City, New York, United States
OnsiteFull Time
Rebar
Rebar: AI-powered operating system for construction trade contractors.
3+ YOEBachelor's degree or higher in CS/EE or related field; 3+ years backend infra; expert Python; 2+ years cloud (AWS); design APIs/SDKs; ML workflows.
Python, AWS, IAM, Networking, Cost Management, APIs, SDKs
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior ML Infrastructure Engineer
New York City, New York, United States
$180k-$230k/yr OnsiteFull Time
Arlo
Arlo: AI-powered health insurance platform providing level-funded plans for businesses.
5+ YOEExperience building scalable data pipelines; proficiency in Spark, Databricks, SQL, PySpark, Python; strong communication; ownership of end-to-end data systems; healthcare/insurance domain preferred.
Spark, Databricks, SQL, PySpark, Python, Git
Job PostingView all
2w
Save
Mark Applied
Hide
Staff ML Engineer - Ads ML Infrastructure
New York City, New York, United States
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
Design, develop, and build scalable machine learning platform capabilities for advertising; collaborate with engineers and data scientists in an Agile environment; focus on performance and privacy.
Job PostingView all
2w
Save
Mark Applied
Hide
Senior ML Ops Engineer
New York, New York, United States
$210k-$300k/yr OnsiteFull Time
Confido
Confido: AI financial operations software for consumer packaged goods brands.
5+ YOE5+ years building production ML/ML platform systems, strong Python and cloud infrastructure skills, experience with IaC and CI/CD, productionizing models and agentic workloads, and ownership of reliability/observability.
Python, Ruby, Ruby on Rails, AWS, Terraform, Kubernetes, GitHub Actions, Snowflake, Aurora/RDS, Redis, Kafka, vLLM, ONNX, TensorRT, MLflow, BentoML, Ray, Airflow, Bedrock, SageMaker, Vertex AI
Job PostingView all
2w
Save
Mark Applied
Hide
Sr. Mgr., ML Infrastructure, PV Personalization and Discovery
Sunnyvale or Seattle or New York
$242k-$328k/yr OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
10+ YOE5+ Mgmt10+ years engineering experience, 5+ years managing engineering teams, expertise in ML infrastructure, retrieval/recommendation systems, LLMs/generative AI, partnering with applied scientists, experience delivering large-scale consumer software.
AWS
Job PostingView all
2mo
Save
Mark Applied
Hide
Infrastructure Engineer
New York or San Francisco or United States
$165k-$200k/yr HybridFull Time
Roboflow
Roboflow: Platform for building and deploying custom computer vision models.
Kubernetes production experience; IaC (Terraform/Helm); cloud (AWS/GCP); Python/Node.js; CI/CD (GitHub Actions/Spacelift); security and ML/AI infrastructure familiarity.
Kubernetes, Terraform, Helm, Python, Node.js, GitHub Actions, Spacelift, AWS, GCP, PyTorch, TensorFlow, Bash
Job PostingView all
2w
Save
Mark Applied
Hide
Machine Learning Infrastructure Engineer
San Francisco or New York or Los Angeles or Seattle
$200k-$345k/yr HybridFull Time
Whatnot
Whatnot: Social marketplace for buying and selling via live streams
4+ YOE4+ years building ML systems,3+ years software engineering,1+ year Python,experience with databases,monitoring,cloud services and production ML deployments.
Python, PostgreSQL, DynamoDB, Elasticsearch, Redis, DataDog, Grafana, AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS, ECS, Apache Kafka, Flink
Job PostingView all
2mo
Save
Mark Applied
Hide
SWE - Backend Infrastructure Engineer
San Francisco or Bellevue or New York
$175k-$280k/yr OnsiteFull Time
Sesame
Sesame: Designing wearable computers with lifelike voice-driven AI agents.
3+ YOEStrong systems thinker with reliability engineering experience; 3+ years in infrastructure, platform, or ML systems; Kubernetes production experience; strong communication.
Kubernetes, Terraform, CloudFormation, Pulumi, TorchServe, Seldon, KServe, Ray Serve, PyTorch, APIs, Database design
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer, Systems ML
Bellevue or Menlo Park or New York
$184k-$257k/yr OnsiteFull Time
Meta
MetaNASDAQ: META: Develops social networking platforms and virtual reality technologies.
8+ YOEBachelor's or equivalent, 8+ years in systems engineering/ML infrastructure, experience with distributed ML training/inference, PyTorch/JAX/TensorFlow, low-level C++/CUDA optimizations, and leading cross-functional ML systems projects.
PyTorch, JAX, TensorFlow, C++, CUDA, MLIR, XLA, TVM, Triton
Job PostingView all
1w
Save
Mark Applied
Hide
Software Engineer, ML Products
New York City, New York, United States
$175k-$275k/yr OnsiteFull Time
Mirage
Mirage: AI platform for automated video creation and professional editing.
5+ YOE5+ years experience building ML/agentic systems, expertise in context engineering (RAG, token optimization), evaluation systems, and production-quality agent infrastructure.
Job PostingView all
2w
Save
Mark Applied
Hide
AI-Enabled Infrastructure and Systems Engineer
New York, New York, United States
$162k-$200k/yr HybridFull Time
BlackRock
BlackRockNYSE: BLK: Provides investment management and financial technology services globally.
5+ YOE5+ years infrastructure engineering experience; cloud (AWS/Azure/GCP) and IaC (Terraform/CloudFormation/ARM/Bicep/Ansible) proficiency; scripting (Python/Java/Golang); experience supporting AI/ML workloads and platform engineering.
Terraform, Ansible, CloudFormation, ARM/Bicep, Python, Java, Golang, AWS, Microsoft Azure ML, Microsoft Azure Foundry, AWS Bedrock, Google Vertex
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Software Engineer - ML Platform
San Francisco or Seattle or New York City
$217k-$289k/yr HybridFull Time
Grow Therapy
Grow Therapy: Platform connecting mental health providers with patients and insurance.
Proven experience designing and building real-time ML systems and infrastructure (feature stores, real-time serving, deployment safety, monitoring). Strong backend engineering, Terraform experience, technical leadership, and cross-team partnership.
Terraform, Gem, One Medical, Headspace, Talkspace
Job PostingView all
2mo
Save
Mark Applied
Hide
Software Engineer, AI/ML (Infrastructure & Platform)
New York City or Tempe or San Francisco
$200k-$235k/yr HybridFull Time
Wealth.com
Wealth.com: Digital estate planning platform for wealth management professionals.
Build AI infrastructure and platform software; strong software engineering, distributed systems, production AI experience.
Python, TypeScript, C#, APIs, Distributed Systems, LLM/AI Systems, Tool/Skill Abstractions, LangChain, Data Pipelines
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Applied ML Research Engineer, Agentic Security
San Francisco or New York City or Amsterdam or Paris or London
RemoteFull Time
Dynamo AI
Dynamo AI: A building enterprise-grade tools for trustworthy generative AI with real-time guardrails, red-teaming, and observability.
Research and engineering experience in ML/CS; experience fine-tuning and evaluating models, writing production code, and building evaluation/monitoring infrastructure. MS or PhD in CS/ML or equivalent research experience preferred.
Job PostingView all
1d
Save
Mark Applied
Hide
Sr Lead Software Engineer - AWS - Lead AI/ML Platform Engineer
Jersey City, New Jersey, United States
$171k-$260k/yr OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years software engineering experience, deep AWS and cloud infrastructure knowledge, production platform and architecture experience, strong client communication, and experience with responsible AI and AI-assisted development.
AWS, Kubernetes, EKS, AWS Sagemaker, Golang, Terraform, LLMs
Job PostingView all
1mo
Save
Mark Applied
Hide
General Application — Data & AI/ML Engineering
New York or United States
HybridFull Time
System
System: AI-powered platform to relate and visualize complex scientific literature.
4+ YOE4+ years in data or ML engineering, strong Python and SQL, experience with Spark/dbt/Airflow, cloud data infrastructure (AWS/GCP/Azure), ML lifecycle and systems design; Bachelor's/Master's in CS/Engineering preferred.
Python, SQL, Spark, dbt, Airflow, AWS, GCP, Azure, Docker, Kubernetes
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer, ML Data Infrastructure
Toronto or New York City
OnsiteFull Time
Ideogram
Ideogram: Generative AI platform for professional graphic design and typography.
2+ YOE2+ years building large-scale distributed systems, strong fundamentals in data structures, algorithms, databases, and large-scale data processing; experience with Python, Kubernetes, GCP, and related data infra is helpful.
Python, Kubernetes, GCP, Google Bigtable, Google BigQuery, Google Spanner, Google Pub/Sub, Docker, Terraform, TPU infrastructure
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Developer Relations Engineer, AI Infrastructure
Sunnyvale or Cambridge or Kirkland or New York or Raleigh or Durham or Seattle
$163k-$237k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
5+ YOEBachelor's in CS or equivalent, 5+ years technical experience, 2+ years running AI/ML workloads on GPUs/TPUs with Kubernetes/GKE, 2+ years producing developer content; Python preferred.
Kubernetes, GKE, GPU, TPU, Python, C++, Java, Vertex AI, Google Cloud
Job PostingView all
1mo
Save
Mark Applied
Hide
ML Ops Lead
New York City or Toronto or United States or Canada
$195k-$245k/yr RemoteFull Time, Contract
FutureFit AI
FutureFit AI: Provides AI-powered career navigation and workforce development software solutions.
Senior MLOps/data engineering experience with strong systems design, hands-on implementation of production data pipelines and ML workflows, fluency with modern data/ML stack and cloud infrastructure (SQL, Python, Airflow, dbt, AWS).
SQL, Python, Airflow, dbt, PostgreSQL, Redshift, MongoDB, AWS SageMaker, Looker, S3, Lambda, Glue
Job PostingView all

Explore Jobs

Expand Your Job Search