18 model serving engineer jobs at 13 companies in Nyack, NY

1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer, Ad Serving
New York or San Jose
$195k-$408k/yr HybridFull Time
Roku
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
10+ YOE10+ years applying machine learning and optimization to production systems; deep statistics/ML expertise; production ML lifecycle experience (feature engineering, model serving, monitoring); strong software skills in Python, SQL, Java/Scala; excellent communication.
Python, SQL, Java/Scala
4d
Save
Mark Applied
Hide
Distributed Systems Engineer 5 - Core Ad Serving Platform
New York City or Seattle or Los Angeles or Los Gatos
$388k-$619k/yr OnsiteFull Time
Netflix
NetflixNASDAQ: NFLX: Provider of global streaming entertainment and video content.
7+ YOE7+ years experience with at least 4+ years in Ads domain, expertise building and operating large-scale distributed systems, ad-server components, API and data model design, SLO-driven development, and incident response.
3w
Save
Mark Applied
Hide
Staff, MLOps Engineer
New York City or San Francisco or United States
$220k-$280k/yr RemoteFull Time
Sequen AI: AI-native ranking engine for enterprise search and recommendations.
4+ YOEMinimum 4+ years MLOps or ML/platform engineering; expertise with low-latency model serving, Python and PyTorch; cloud (AWS/GCP/Azure), Docker, Kubernetes, MLflow; strong distributed systems and pipeline experience.
Python, PyTorch, AWS, GCP, Azure, Docker, Kubernetes, MLflow, Rust, vLLM, Triton
2d
Save
Mark Applied
Hide
Distinguished AI Engineer
Jersey City, New Jersey, United States
$140k-$210k/yr OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
10+ YOE10+ years in AI/ML, distributed systems, enterprise architecture or platform engineering; deep LLM, RAG, embeddings, model-serving and AWS experience; Terraform/IaC and DevOps pipeline expertise; ability to influence senior stakeholders.
AWS, Terraform, IaC, DevOps, LLMs, RAG
1mo
Save
Mark Applied
Hide
AI Field Engineer - AI Natives
New York or San Mateo or United States
$200k-$260k/yr OnsiteFull Time
Fireworks AI
Fireworks AI: Provide high-speed inference and infrastructure for generative AI models.
5+ YOE5+ years in customer-facing technical roles building production software; strong Python and Kubernetes skills; experience with LLM inference, model serving, fine-tuning workflows, GPU/cloud deployments, and excellent communication.
Python, Kubernetes, vLLM, SGLang, TensorRT-LLM, AWS, Azure, GCP, Azure AI Foundry, AWS Bedrock, SageMaker, GCP Vertex
2mo
Save
Mark Applied
Hide
Machine Learning Engineer 5 - Decisioning & Optimization
New York City or Seattle or Los Angeles or Los Gatos
$466k-$750k/yr OnsiteFull Time
Netflix
NetflixNASDAQ: NFLX: Provider of global streaming entertainment and video content.
7+ YOE7+ years software engineering experience with 3+ years on ML infrastructure or model serving; proficiency in Java, Python, or Scala; experience building high‑QPS, low‑latency model serving, feature serving, and model monitoring.
Java, Python, Scala, Chronon, Signal Service, JVM
2w
Save
Mark Applied
Hide
Senior AI Engineer
Chicago or Hong Kong or London or New York City or Singapore
$200k-$300k/yr OnsiteFull Time
DV Trading
DV Trading: Proprietary trading firm providing liquidity to global financial markets.
5+ YOE5+ years software engineering with strong Python; production fine-tuning/distillation of open-weight models; on-prem LLM serving, GPU infrastructure and Kubernetes experience; model evaluation and tooling.
Python, Llama, Qwen, Mistral, vLLM, TGI, Triton, Kubernetes, Hugging Face
2mo
Save
Mark Applied
Hide
Machine Learning Engineer 5 - Decisioning & Optimization
New York or Los Angeles or Los Gatos or Seattle
$466k-$750k/yr OnsiteFull Time
Netflix
NetflixNASDAQ: NFLX: Global video streaming and media production service.
7+ YOE7+ years software engineering; 3+ years ML infrastructure, model serving, or ML platform experience in ads/real-time decisioning; real-time model serving with sub-20ms latency; proficiency in Java, Python, or Scala; experience with ML serving frameworks and real-time feature pipelines; strong model monitoring and production readiness.
Java, Python, Scala, ML serving frameworks, feature stores, model registries
1mo
Save
Mark Applied
Hide
Senior Machine Learning Operations Engineer
New York City, New York, United States
$256k-$285k/yr HybridFull Time
Garner Health
Garner Health: Identifies high-quality doctors to lower employer healthcare costs.
5+ YOE5+ years software engineering experience operating ML or data-intensive systems; hands-on with model serving, feature stores, model registries, ML CI/CD, Kubernetes, cloud (AWS), Terraform, observability, and incident response.
Python, Kubernetes, AWS, Sagemaker, Triton, Terraform, S3, Snowflake, Airflow, Datadog
1mo
Save
Mark Applied
Hide
Computer Vision Engineer
Brooklyn or New York City
$230k-$260k/yr OnsiteFull Time
Pangram Labs
Pangram Labs: Detects AI-generated text and verifies content authenticity.
3+ YOE3+ years building and deploying ML systems or a PhD; experience training neural networks in PyTorch, distributed training, model serving and production infrastructure, and deep understanding of generative image models.
PyTorch, MLOps, CI/CD, LLMs
1mo
Save
Mark Applied
Hide
Staff Machine Learning Operations Engineer
New York City, New York, United States
$298k-$351k/yr HybridFull Time
Garner Health
Garner Health: Identifies high-quality doctors to lower employer healthcare costs.
7+ YOE7+ years software engineering experience operating ML or data-intensive systems in production; deep experience with model serving, feature stores, model registries, ML CI/CD, Kubernetes, cloud (AWS), Terraform, observability, and incident response.
Python, Kubernetes, AWS, Amazon SageMaker, Triton, Terraform, Amazon S3, Snowflake, Apache Airflow, Datadog
2d
Save
Mark Applied
Hide
Machine Learning Engineer
New York City, New York, United States
$180k-$230k/yr OnsiteFull Time
Arlo
Arlo: AI-powered health insurance platform providing level-funded plans for businesses.
Experience building production ML or data infrastructure at scale; strong Python skills; experience with Spark/Databricks, model training pipelines and low-latency serving; ownership of SLAs, monitoring, and on-call; interest in applied modeling.
Python, Spark, Databricks, MLflow
3w
Save
Mark Applied
Hide
Senior Engineer, ML Engineering (Databricks)
New York or Chicago or Boston or Toronto or London
$130k-$147k/yr HybridFull Time
Curinos
Curinos: Providing data-driven decision intelligence for global financial institutions.
Experience operationalizing production ML/AI on Databricks, MLflow, Databricks Model Serving; strong Python, Spark, SQL; CI/CD and monitoring for model performance, safety, and governance.
Databricks, Databricks Workflows, Delta Lake, Delta Live Tables, Asset Bundles, Unity Catalog, Genie Code, MonteCarlo, Fiddler, MLflow, Databricks Model Serving, Python, Spark, SQL, Jenkins, shell, Yarn, AWS, chatGPT, Claude, Copilot
2mo
Save
Mark Applied
Hide
Inference Performance Engineer
New York, New York, United States
HybridFull Time
Material
Material: Specialized inference cloud platform for high-performance AI workloads.
BS in CS/EE or related field; proficiency in Rust/Go/Python/C++; knowledge of concurrency, tail latency; experience with model serving; GPU/ASIC programming; low-precision inference; profiling and benchmarking.
Rust, Go, Python, C++, vLLM, TensorRT-LLM, llama.cpp, CUDA, ROCm, Triton, TGI, SGLang, Nsight, perf
2w
Save
Mark Applied
Hide
Contract Logistics Job Ad Template
Jersey City, New Jersey, United States
HybridFull Time
Kuehne+Nagel
Kuehne+NagelSIX Swiss Exchange: KNIN: Provides global logistics, freight forwarding, and supply chain solutions.
5+ YOEBachelor's in supply chain/logistics/engineering/analytics or equivalent; 5+ years in transportation/logistics; 3+ years in 3PL; experience with TMS, pricing, network modeling, cost-to-serve and tender pricing.
TMS
2w
Save
Mark Applied
Hide
Contract Logistics Job Ad Template
Jersey City, New Jersey, United States
HybridFull Time
Kuehne+Nagel
Kuehne+NagelSIX Swiss Exchange: KNIN: Global provider of logistics and supply chain services.
5+ YOEBachelor’s degree or equivalent experience,5+ years in transportation/logistics with 3+ years 3PL exposure,expertise in parcel/LTL/FTL pricing,network modeling,cost-to-serve and tender/pricing leadership.
TMS
1mo
Save
Mark Applied
Hide
Director of Data
United States or Canada or San Francisco or New York City or Seattle or Boston or Chicago or Denver or Austin or Portland
$195k-$358k/yr RemoteFull Time
Outschool
Outschool: Marketplace for live online small-group classes for children.
10+ YOE5+ Mgmt10+ years in data/analytics/engineering roles, 5+ years managing data or analytics teams, strong SQL/dbt/data modeling skills, experience with Redshift, self-serve analytics tools, experimentation, and stakeholder communication.
Redshift, dbt, Opensearch, Omni, Amplitude, Statsig, Looker, Mode, Hex, SQL, Covey Scout
1mo
Save
Mark Applied
Hide
Solution Specialist, AI Runtime Services
Livingston or New York or Sunnyvale or San Francisco or Bellevue
$207k-$275k/yr OnsiteFull Time
CoreWeave
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
10+ YOE10+ years in distributed systems/ML infrastructure or production AI engineering; 5+ years with AI runtime systems; expertise in model serving, batching, execution isolation, GPU memory management, and Kubernetes; strong customer-facing and commercial skills.
vLLM, TensorRT-LLM, TGI, Triton, Kubernetes, Inference, Sandboxes