HiringCafe
Join our community

26 model serving engineer jobs at 16 companies in Edison, NJ

PromotedHiringCafe
ML Engineer - Inference & Model Deployment
Cupertino, CA, US
$250k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Turn powerful AI and ML models into fast, reliable production systems. Own inference latency, throughput, model-serving architecture, multi-GPU systems, and production deployment for millions of users.
Python, PyTorch, vLLM, SGLang, TensorRT, LLMs
Help us #BeatIndeed & #BeatLinkedIn
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer, Ad Serving
New York or San Jose
$195k-$408k/yr HybridFull Time
Roku
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
10+ YOE10+ years applying machine learning and optimization to production systems; deep statistics/ML expertise; production ML lifecycle experience (feature engineering, model serving, monitoring); strong software skills in Python, SQL, Java/Scala; excellent communication.
Python, SQL, Java/Scala
Job PostingView all
3mo
Save
Mark Applied
Hide
Software Engineer, Model Routing & Inference
New York or San Francisco
OnsiteFull Time
Cursor
Cursor: AI-powered code editor for professional software developers.
Experience building high-throughput, low-latency distributed systems; inference serving; traffic routing; production software delivery; cost-performance tradeoffs.
Job PostingView all
1w
Save
Mark Applied
Hide
Staff, MLOps Engineer
New York City or San Francisco or United States
$220k-$280k/yr RemoteFull Time
Sequen AI: AI-native ranking engine for enterprise search and recommendations.
4+ YOEMinimum 4+ years MLOps or ML/platform engineering; expertise with low-latency model serving, Python and PyTorch; cloud (AWS/GCP/Azure), Docker, Kubernetes, MLflow; strong distributed systems and pipeline experience.
Python, PyTorch, AWS, GCP, Azure, Docker, Kubernetes, MLflow, Rust, vLLM, Triton
Job PostingView all
2w
Save
Mark Applied
Hide
Distinguished AI Engineer - Onsite in Jersey City, NJ
Jersey City, New Jersey, United States
$140k-$210k/yr OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
10+ YOE10+ years in AI/ML systems or platform engineering; deep experience with LLMs, RAG, embeddings, model serving, LLMOps/MLOps, GPU/inference optimization, governance, and stakeholder engagement.
LLMs, LLMOps, MLOps, RAG, embeddings, AI gateways, model-serving, model hubs, agent frameworks, orchestration layers, GPU, evaluation frameworks, observability
Job PostingView all
2mo
Save
Mark Applied
Hide
Distributed Systems Engineer 5 - Decisioning & Optimization
New York or Los Angeles or Los Gatos or Seattle
$388k-$619k/yr OnsiteFull Time
Netflix
NetflixNASDAQ: NFLX: Global video streaming and media production service.
7+ YOE7+ years building distributed systems; ads domain experience; ML model serving; backend APIs and ad tech systems; low-latency serving; collaboration across teams.
ML model serving, real-time inference, APIs, ad servers, bidders, pacing, routing, calibration serving
Job PostingView all
2mo
Save
Mark Applied
Hide
Distributed Systems Engineer 6 - Decisioning & Optimization
New York City or Seattle or Los Angeles or Los Gatos
$499k-$900k/yr OnsiteFull Time
Netflix
NetflixNASDAQ: NFLX: Provider of global streaming entertainment and video content.
10+ YOE10+ years building large-scale distributed systems (3+ years in ads); expertise in ML model serving with sub-20ms P99, ad serving/bidding/pacing systems, API and platform design, technical leadership, and cross-functional collaboration.
Job PostingView all
1mo
Save
Mark Applied
Hide
AI Field Engineer - AI Natives
New York or San Mateo or United States
$200k-$260k/yr OnsiteFull Time
Fireworks AI
Fireworks AI: Provide high-speed inference and infrastructure for generative AI models.
5+ YOE5+ years in customer-facing technical roles building production software; strong Python and Kubernetes skills; experience with LLM inference, model serving, fine-tuning workflows, GPU/cloud deployments, and excellent communication.
Python, Kubernetes, vLLM, SGLang, TensorRT-LLM, AWS, Azure, GCP, Azure AI Foundry, AWS Bedrock, SageMaker, GCP Vertex
Job PostingView all
2w
Save
Mark Applied
Hide
Distinguished AI Engineer - Onsite in Jersey City, NJ
Jersey City, New Jersey, United States
$140k-$210k/yr OnsiteFull Time
NTT DATA
NTT DATATokyo Stock Exchange: 9613: Global provider of business and technology consulting and IT services.
10+ YOE10+ years in AI/ML systems, platform or enterprise architecture; deep LLM, RAG, embeddings, model serving and GPU/inference experience; ability to define standards and influence senior stakeholders.
LLMs, RAG, embeddings, GPU
Job PostingView all
1d
Save
Mark Applied
Hide
Senior AI Engineer
Chicago or Hong Kong or London or New York City or Singapore
$200k-$300k/yr OnsiteFull Time
DV Trading
DV Trading: Proprietary trading firm providing liquidity to global financial markets.
5+ YOE5+ years software engineering with strong Python; production fine-tuning/distillation of open-weight models; on-prem LLM serving, GPU infrastructure and Kubernetes experience; model evaluation and tooling.
Python, Llama, Qwen, Mistral, vLLM, TGI, Triton, Kubernetes, Hugging Face
Job PostingView all
1mo
Save
Mark Applied
Hide
Machine Learning Engineer III - FES
New York, New York, United States
$117k-$167k/yr RemoteFull Time
Fanatics
Fanatics: Global digital sports platform for merchandise, collectibles, and betting.
3+ YOE3–5+ years in ML or data engineering; strong Python; experience with Databricks/SageMaker; real-time feature pipelines and model serving; SQL; distributed systems.
Python, Databricks, AWS SageMaker, Spark, Kafka, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Machine Learning Operations Engineer
New York City, New York, United States
$256k-$285k/yr HybridFull Time
Garner Health
Garner Health: Identifies high-quality doctors to lower employer healthcare costs.
5+ YOE5+ years software engineering experience operating ML or data-intensive systems; hands-on with model serving, feature stores, model registries, ML CI/CD, Kubernetes, cloud (AWS), Terraform, observability, and incident response.
Python, Kubernetes, AWS, Sagemaker, Triton, Terraform, S3, Snowflake, Airflow, Datadog
Job PostingView all
3w
Save
Mark Applied
Hide
Computer Vision Engineer
Brooklyn or New York City
$230k-$260k/yr OnsiteFull Time
Pangram Labs
Pangram Labs: Detects AI-generated text and verifies content authenticity.
3+ YOE3+ years building and deploying ML systems or a PhD; experience training neural networks in PyTorch, distributed training, model serving and production infrastructure, and deep understanding of generative image models.
PyTorch, MLOps, CI/CD, LLMs
Job PostingView all
3mo
Save
Mark Applied
Hide
ML Infrastructure/Platform Engineer
New York City, New York, United States
$140k-$200k/yr HybridFull Time
Anthelion Capital
Anthelion Capital: AI-powered investment firm specializing in private credit and data science.
3+ YOE3+ years in data engineering or ML infrastructure; Python and SQL; orchestration tools (Prefect/Airflow/Dagster); Docker/Kubernetes; cloud (Azure preferred); model serving; monitoring; strong documentation.
Python, SQL, Prefect, Airflow, Dagster, Docker, Kubernetes, Azure, MLflow, LangChain, Snowflake, dbt
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Engineer, ML Engineering (Databricks)
New York or Chicago or Boston or Toronto or London
$130k-$147k/yr HybridFull Time
Curinos
Curinos: Providing data-driven decision intelligence for global financial institutions.
Experience operationalizing production ML/AI on Databricks, MLflow, Databricks Model Serving; strong Python, Spark, SQL; CI/CD and monitoring for model performance, safety, and governance.
Databricks, Databricks Workflows, Delta Lake, Delta Live Tables, Asset Bundles, Unity Catalog, Genie Code, MonteCarlo, Fiddler, MLflow, Databricks Model Serving, Python, Spark, SQL, Jenkins, shell, Yarn, AWS, chatGPT, Claude, Copilot
Job PostingView all
2mo
Save
Mark Applied
Hide
Inference Performance Engineer
New York, New York, United States
HybridFull Time
Material
Material: Specialized inference cloud platform for high-performance AI workloads.
BS in CS/EE or related field; proficiency in Rust/Go/Python/C++; knowledge of concurrency, tail latency; experience with model serving; GPU/ASIC programming; low-precision inference; profiling and benchmarking.
Rust, Go, Python, C++, vLLM, TensorRT-LLM, llama.cpp, CUDA, ROCm, Triton, TGI, SGLang, Nsight, perf
Job PostingView all
1d
Save
Mark Applied
Hide
Contract Logistics Job Ad Template
Jersey City, New Jersey, United States
HybridFull Time
Kuehne+Nagel
Kuehne+NagelSIX Swiss Exchange: KNIN: Provides global logistics, freight forwarding, and supply chain solutions.
5+ YOEBachelor's in supply chain/logistics/engineering/analytics or equivalent; 5+ years in transportation/logistics; 3+ years in 3PL; experience with TMS, pricing, network modeling, cost-to-serve and tender pricing.
TMS
Job PostingView all
3d
Save
Mark Applied
Hide
Head of AI & Agentic Platform Engineering
New York City or La Jolla or Bothell or Collegeville or Walton Oaks or Tampa or Dublin or Sandwich or Groton or Thessaloniki or Berlin
$300k-$500k/yr HybridFull Time
Pfizer
PfizerNYSE: PFE: Develops and manufactures vaccines and medicines for global healthcare
12+ YOE7+ Mgmt12+ years software/infrastructure engineering with 7+ years in AI/ML platform or MLOps at scale; deep experience with multi-tenant AI infrastructure, LLM gateway, model serving, compute provisioning, IaC (Terraform), multi-cloud, security, and regulated environments (GxP).
Terraform, Azure, AWS, GCP, SLURM, LSF
Job PostingView all
1d
Save
Mark Applied
Hide
Contract Logistics Job Ad Template
Jersey City, New Jersey, United States
HybridFull Time
Kuehne+Nagel
Kuehne+NagelSIX Swiss Exchange: KNIN: Global provider of logistics and supply chain services.
5+ YOEBachelor’s degree or equivalent experience,5+ years in transportation/logistics with 3+ years 3PL exposure,expertise in parcel/LTL/FTL pricing,network modeling,cost-to-serve and tender/pricing leadership.
TMS
Job PostingView all
1mo
Save
Mark Applied
Hide
Director of Data
United States or Canada or San Francisco or New York City or Seattle or Boston or Chicago or Denver or Austin or Portland
$195k-$358k/yr RemoteFull Time
Outschool
Outschool: Marketplace for live online small-group classes for children.
10+ YOE5+ Mgmt10+ years in data/analytics/engineering roles, 5+ years managing data or analytics teams, strong SQL/dbt/data modeling skills, experience with Redshift, self-serve analytics tools, experimentation, and stakeholder communication.
Redshift, dbt, Opensearch, Omni, Amplitude, Statsig, Looker, Mode, Hex, SQL, Covey Scout
Job PostingView all
3w
Save
Mark Applied
Hide
Solution Specialist, AI Runtime Services
Livingston or New York or Sunnyvale or San Francisco or Bellevue
$207k-$275k/yr OnsiteFull Time
CoreWeave
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
10+ YOE10+ years in distributed systems/ML infrastructure or production AI engineering; 5+ years with AI runtime systems; expertise in model serving, batching, execution isolation, GPU memory management, and Kubernetes; strong customer-facing and commercial skills.
vLLM, TensorRT-LLM, TGI, Triton, Kubernetes, Inference, Sandboxes
Job PostingView all

Explore Jobs

Expand Your Job Search