18 model serving engineer jobs at 14 companies in Secaucus, NJ
2mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer, Ad Serving
New York or San Jose
$195k-$408k/yr HybridFull Time
10+ YOE10+ years applying machine learning and optimization to production systems; deep statistics/ML expertise; production ML lifecycle experience (feature engineering, model serving, monitoring); strong software skills in Python, SQL, Java/Scala; excellent communication.
Python, SQL, Java/Scala
1mo
Save
Mark Applied
Hide
Distributed Systems Engineer 5 - Core Ad Serving Platform
New York City or Seattle or Los Angeles or Los Gatos
$388k-$619k/yr OnsiteFull Time
7+ YOE7+ years experience with at least 4+ years in Ads domain, expertise building and operating large-scale distributed systems, ad-server components, API and data model design, SLO-driven development, and incident response.
1mo
Save
Mark Applied
Hide
Staff, MLOps Engineer
New York City or San Francisco or United States
$220k-$280k/yr RemoteFull Time
4+ YOEMinimum 4+ years MLOps or ML/platform engineering; expertise with low-latency model serving, Python and PyTorch; cloud (AWS/GCP/Azure), Docker, Kubernetes, MLflow; strong distributed systems and pipeline experience.
Python, PyTorch, AWS, GCP, Azure, Docker, Kubernetes, MLflow, Rust, vLLM, Triton
2mo
Save
Mark Applied
Hide
Machine Learning Engineer 5 - Decisioning & Optimization
New York City or Seattle or Los Angeles or Los Gatos
$466k-$750k/yr OnsiteFull Time
7+ YOE7+ years software engineering experience with 3+ years on ML infrastructure or model serving; proficiency in Java, Python, or Scala; experience building high‑QPS, low‑latency model serving, feature serving, and model monitoring.
Java, Python, Scala, Chronon, Signal Service, JVM
1mo
Save
Mark Applied
Hide
Senior AI Engineer
Chicago or Hong Kong or London or New York City or Singapore
$200k-$300k/yr OnsiteFull Time
5+ YOE5+ years software engineering with strong Python; production fine-tuning/distillation of open-weight models; on-prem LLM serving, GPU infrastructure and Kubernetes experience; model evaluation and tooling.
Python, Llama, Qwen, Mistral, vLLM, TGI, Triton, Kubernetes, Hugging Face
2mo
Save
Mark Applied
Hide
Machine Learning Engineer 5 - Decisioning & Optimization
New York or Los Angeles or Los Gatos or Seattle
$466k-$750k/yr OnsiteFull Time
7+ YOE7+ years software engineering; 3+ years ML infrastructure, model serving, or ML platform experience in ads/real-time decisioning; real-time model serving with sub-20ms latency; proficiency in Java, Python, or Scala; experience with ML serving frameworks and real-time feature pipelines; strong model monitoring and production readiness.
Java, Python, Scala, ML serving frameworks, feature stores, model registries
3w
Save
Mark Applied
Hide
Senior Staff Machine Learning Engineer
Brooklyn or United States
$245k-$319k/yr RemoteFull Time
10+ YOE10+ years in ML and AI; expertise in large-scale model training and serving, productionizing models, data and ML frameworks, ambiguous technical problems, cross-functional delivery, and engineering mentorship.
Apache Spark, Apache Beam, Apache Hadoop, TensorFlow, PyTorch, Scikit-learn
2w
Save
Mark Applied
Hide
Analytics Engineer
Stockholm or Boston or New York
HybridFull Time
Requires strong SQL, analytical data modeling, ELT/ETL, cloud warehouse, Python, dashboard, BI, communication, and self-serve analytics experience.
SQL, dbt, SQLMesh, Snowflake, BigQuery, Redshift, Databricks, Python, Hex, Lovable
2mo
Save
Mark Applied
Hide
Staff Machine Learning Operations Engineer
New York City, New York, United States
$298k-$351k/yr HybridFull Time
7+ YOE7+ years software engineering experience operating ML or data-intensive systems in production; deep experience with model serving, feature stores, model registries, ML CI/CD, Kubernetes, cloud (AWS), Terraform, observability, and incident response.
Python, Kubernetes, AWS, Amazon SageMaker, Triton, Terraform, Amazon S3, Snowflake, Apache Airflow, Datadog
1mo
Save
Mark Applied
Hide
Machine Learning Engineer
New York City, New York, United States
$180k-$230k/yr OnsiteFull Time
Experience building production ML or data infrastructure at scale; strong Python skills; experience with Spark/Databricks, model training pipelines and low-latency serving; ownership of SLAs, monitoring, and on-call; interest in applied modeling.
Python, Spark, Databricks, MLflow
1mo
Save
Mark Applied
Hide
Senior Engineer, ML Engineering (Databricks)
New York or Chicago or Boston or Toronto or London
$130k-$147k/yr HybridFull Time
Experience operationalizing production ML/AI on Databricks, MLflow, Databricks Model Serving; strong Python, Spark, SQL; CI/CD and monitoring for model performance, safety, and governance.
Databricks, Databricks Workflows, Delta Lake, Delta Live Tables, Asset Bundles, Unity Catalog, Genie Code, MonteCarlo, Fiddler, MLflow, Databricks Model Serving, Python, Spark, SQL, Jenkins, shell, Yarn, AWS, chatGPT, Claude, Copilot
2mo
Save
Mark Applied
Hide
AI Engineer (Applied LLM Systems)
New York City, New York, United States
$165k-$200k/yr OnsiteFull Time
Experience building production LLM/ML features end-to-end, hands-on with agentic orchestration, self-hosted model serving, strong Python and evaluation design skills.
vLLM, TGI, Python
3mo
Save
Mark Applied
Hide
Inference Performance Engineer
New York, New York, United States
HybridFull Time
BS in CS/EE or related field; proficiency in Rust/Go/Python/C++; knowledge of concurrency, tail latency; experience with model serving; GPU/ASIC programming; low-precision inference; profiling and benchmarking.
Rust, Go, Python, C++, vLLM, TensorRT-LLM, llama.cpp, CUDA, ROCm, Triton, TGI, SGLang, Nsight, perf
1w
Save
Mark Applied
Hide
Senior Machine Learning Product Engineer, Consumer Alliance (all genders)
Warsaw or New York City or Berlin or London or Sydney
OnsiteFull Time
5+ YOEApproximately 5 years building and operating production ML systems; expertise across Python, Apache Spark, pipelines, model serving, observability, recommender systems, experiments, and large-scale personalization.
Claude Code, Cursor, Copilot, Python, Apache Spark, Kafka, Kubernetes
1mo
Save
Mark Applied
Hide
Contract Logistics Job Ad Template
Jersey City, New Jersey, United States
HybridFull Time
5+ YOEBachelor's in supply chain/logistics/engineering/analytics or equivalent; 5+ years in transportation/logistics; 3+ years in 3PL; experience with TMS, pricing, network modeling, cost-to-serve and tender pricing.
TMS
2mo
Save
Mark Applied
Hide
Advisory AI Architect (FDE Unit)
New York City or Washington or Connecticut or Massachusetts or New Jersey
$286k-$371k/yr RemoteFull Time
6+ YOE6+ years in enterprise architecture/AI/ML platforms or systems engineering; hands-on experience with model serving, orchestration, retrieval pipelines, vector stores; CI/CD, IaC, observability; delivering production AI or large-scale distributed systems; ability to travel to customer sites.
Kubernetes, CI/CD, Infrastructure-as-Code, Dell AI Factory, GenAI, RAG
1mo
Save
Mark Applied
Hide
Contract Logistics Job Ad Template
Jersey City, New Jersey, United States
HybridFull Time
5+ YOEBachelor’s degree or equivalent experience,5+ years in transportation/logistics with 3+ years 3PL exposure,expertise in parcel/LTL/FTL pricing,network modeling,cost-to-serve and tender/pricing leadership.
TMS
2mo
Save
Mark Applied
Hide
Solution Specialist, AI Runtime Services
Livingston or New York or Sunnyvale or San Francisco or Bellevue
$207k-$275k/yr OnsiteFull Time
10+ YOE10+ years in distributed systems/ML infrastructure or production AI engineering; 5+ years with AI runtime systems; expertise in model serving, batching, execution isolation, GPU memory management, and Kubernetes; strong customer-facing and commercial skills.
vLLM, TensorRT-LLM, TGI, Triton, Kubernetes, Inference, Sandboxes
Explore Jobs