17 model serving engineer jobs at 12 companies in Merrick, NY
1mo
Save
Mark Applied
Hide
1mo
Senior Machine Learning Engineer, Ad Serving
New York or San Jose
$195k-$408k/yrHybridFull Time
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
10+ YOE10+ years applying machine learning and optimization to production systems; deep statistics/ML expertise; production ML lifecycle experience (feature engineering, model serving, monitoring); strong software skills in Python, SQL, Java/Scala; excellent communication.
Distributed Systems Engineer 5 - Core Ad Serving Platform
New York City or Seattle or Los Angeles or Los Gatos
$388k-$619k/yrOnsiteFull Time
NetflixNASDAQ: NFLX: Provider of global streaming entertainment and video content.
7+ YOE7+ years experience with at least 4+ years in Ads domain, expertise building and operating large-scale distributed systems, ad-server components, API and data model design, SLO-driven development, and incident response.
Sequen AI: AI-native ranking engine for enterprise search and recommendations.
4+ YOEMinimum 4+ years MLOps or ML/platform engineering; expertise with low-latency model serving, Python and PyTorch; cloud (AWS/GCP/Azure), Docker, Kubernetes, MLflow; strong distributed systems and pipeline experience.
NTT DATA: Global provider of IT and business consulting services.
10+ YOE10+ years in AI/ML, distributed systems, enterprise architecture or platform engineering; deep LLM, RAG, embeddings, model-serving and AWS experience; Terraform/IaC and DevOps pipeline expertise; ability to influence senior stakeholders.
New York City or Seattle or Los Angeles or Los Gatos
$466k-$750k/yrOnsiteFull Time
NetflixNASDAQ: NFLX: Provider of global streaming entertainment and video content.
7+ YOE7+ years software engineering experience with 3+ years on ML infrastructure or model serving; proficiency in Java, Python, or Scala; experience building high‑QPS, low‑latency model serving, feature serving, and model monitoring.
Chicago or Hong Kong or London or New York City or Singapore
$200k-$300k/yrOnsiteFull Time
DV Trading: Proprietary trading firm providing liquidity to global financial markets.
5+ YOE5+ years software engineering with strong Python; production fine-tuning/distillation of open-weight models; on-prem LLM serving, GPU infrastructure and Kubernetes experience; model evaluation and tooling.
Python, Llama, Qwen, Mistral, vLLM, TGI, Triton, Kubernetes, Hugging Face
NetflixNASDAQ: NFLX: Global video streaming and media production service.
7+ YOE7+ years software engineering; 3+ years ML infrastructure, model serving, or ML platform experience in ads/real-time decisioning; real-time model serving with sub-20ms latency; proficiency in Java, Python, or Scala; experience with ML serving frameworks and real-time feature pipelines; strong model monitoring and production readiness.
Java, Python, Scala, ML serving frameworks, feature stores, model registries
Garner Health: Identifies high-quality doctors to lower employer healthcare costs.
5+ YOE5+ years software engineering experience operating ML or data-intensive systems; hands-on with model serving, feature stores, model registries, ML CI/CD, Kubernetes, cloud (AWS), Terraform, observability, and incident response.
Pangram Labs: Detects AI-generated text and verifies content authenticity.
3+ YOE3+ years building and deploying ML systems or a PhD; experience training neural networks in PyTorch, distributed training, model serving and production infrastructure, and deep understanding of generative image models.
Garner Health: Identifies high-quality doctors to lower employer healthcare costs.
7+ YOE7+ years software engineering experience operating ML or data-intensive systems in production; deep experience with model serving, feature stores, model registries, ML CI/CD, Kubernetes, cloud (AWS), Terraform, observability, and incident response.
New York or Chicago or Boston or Toronto or London
$130k-$147k/yrHybridFull Time
Curinos: Providing data-driven decision intelligence for global financial institutions.
Experience operationalizing production ML/AI on Databricks, MLflow, Databricks Model Serving; strong Python, Spark, SQL; CI/CD and monitoring for model performance, safety, and governance.
Databricks, Databricks Workflows, Delta Lake, Delta Live Tables, Asset Bundles, Unity Catalog, Genie Code, MonteCarlo, Fiddler, MLflow, Databricks Model Serving, Python, Spark, SQL, Jenkins, shell, Yarn, AWS, chatGPT, Claude, Copilot
Arlo: AI-powered health insurance platform providing level-funded plans for businesses.
Experience building production ML or data infrastructure at scale; strong Python skills; experience with Spark/Databricks, model training pipelines and low-latency serving; ownership of SLAs, monitoring, and on-call; interest in applied modeling.
Material: Specialized inference cloud platform for high-performance AI workloads.
BS in CS/EE or related field; proficiency in Rust/Go/Python/C++; knowledge of concurrency, tail latency; experience with model serving; GPU/ASIC programming; low-precision inference; profiling and benchmarking.
Kuehne+NagelSIX Swiss Exchange: KNIN: Provides global logistics, freight forwarding, and supply chain solutions.
5+ YOEBachelor's in supply chain/logistics/engineering/analytics or equivalent; 5+ years in transportation/logistics; 3+ years in 3PL; experience with TMS, pricing, network modeling, cost-to-serve and tender pricing.
Kuehne+NagelSIX Swiss Exchange: KNIN: Global provider of logistics and supply chain services.
5+ YOEBachelor’s degree or equivalent experience,5+ years in transportation/logistics with 3+ years 3PL exposure,expertise in parcel/LTL/FTL pricing,network modeling,cost-to-serve and tender/pricing leadership.
United States or Canada or San Francisco or New York City or Seattle or Boston or Chicago or Denver or Austin or Portland
$195k-$358k/yrRemoteFull Time
Outschool: Marketplace for live online small-group classes for children.
10+ YOE5+ Mgmt10+ years in data/analytics/engineering roles, 5+ years managing data or analytics teams, strong SQL/dbt/data modeling skills, experience with Redshift, self-serve analytics tools, experimentation, and stakeholder communication.
Livingston or New York or Sunnyvale or San Francisco or Bellevue
$207k-$275k/yrOnsiteFull Time
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
10+ YOE10+ years in distributed systems/ML infrastructure or production AI engineering; 5+ years with AI runtime systems; expertise in model serving, batching, execution isolation, GPU memory management, and Kubernetes; strong customer-facing and commercial skills.