9 model serving engineer jobs at 8 companies in Sanborn, NY
1mo
Save
Mark Applied
Hide
Principal Applied AI Developer, Foundation Models Infrastructure
Quebec or Toronto or Canada
$153k-$224k/yr RemoteFull Time
8+ YOE8+ years software engineering experience with large-scale cloud-native or ML infrastructure; hands-on with Kubernetes, Ray, SageMaker, AWS; experience designing production ML training/serving platforms, CI/CD, infrastructure-as-code, and mentoring engineers.
Kubernetes, Ray, SageMaker, AWS
1mo
Save
Mark Applied
Hide
Senior Staff Machine Learning Engineer, Menu Personalisation (m,f,x)
Berlin or Toronto
HybridFull Time
8+ YOE8+ years building and operating production ML systems; recommender experience preferred; hands-on with Python, Spark, Go, Kafka, Kubernetes; production model serving, feature pipelines, observability, experimentation, and technical leadership.
Python, Spark, Go, Kafka, Kubernetes, Claude Code, Cursor, Copilot
1w
Save
Mark Applied
Hide
Software Engineer II — Agentic AI Foundations
Toronto, Ontario, Canada
$135k-$175k/yr HybridFull Time
2+ YOERequires 2+ years of software engineering experience, strong LLM and agentic AI knowledge, GPU/model-serving expertise, distributed systems fundamentals, and proficiency in Java, Go, Python, or similar.
CUDA, vLLM, Ollama, LLMLite, TensorRT-LLM, Triton Inference Server, Java, Go, Python, A/B testing, YouTube, LinkedIn, X (Twitter), Facebook
1mo
Save
Mark Applied
Hide
Staff Software Engineer
Toronto or Calgary
OnsiteFull Time
Design and implement scalable AI services and distributed systems; expertise in APIs, microservices, containerization, cloud deployment, Python/Golang, observability, and ML model serving.
Python, Golang, Docker, Kubernetes, OpenShift Container Platform (OCP4), AWS, Azure, MongoDB, SQL Databases, CI/CD, Application Performance Management (APM), Agentic AI
1mo
Save
Mark Applied
Hide
Senior Engineer, ML Engineering (Databricks)
New York or Chicago or Boston or Toronto or London
$130k-$147k/yr HybridFull Time
Experience operationalizing production ML/AI on Databricks, MLflow, Databricks Model Serving; strong Python, Spark, SQL; CI/CD and monitoring for model performance, safety, and governance.
Databricks, Databricks Workflows, Delta Lake, Delta Live Tables, Asset Bundles, Unity Catalog, Genie Code, MonteCarlo, Fiddler, MLflow, Databricks Model Serving, Python, Spark, SQL, Jenkins, shell, Yarn, AWS, chatGPT, Claude, Copilot
3w
Save
Mark Applied
Hide
Machine Learning Engineer - Express Scripts Canada
Mississauga, Ontario, Canada
$115k-$125k/yr HybridFull Time
5+ YOE5+ years application development, 3–5 years ML/data engineering with Python; experience with Oracle, SQLAlchemy, ETL, unsupervised models, API serving, CI/CD; bachelor's degree or equivalent.
Oracle, SQLAlchemy, oracledb, Python, FastAPI, Pydantic, joblib, MiniBatchKMeans, KMeans, DBSCAN, TruncatedSVD, PCA, scikit-learn, NumPy, pandas, SciPy, matplotlib, seaborn, argparse, httpx, Jenkins, OpenShift, Docker, Git
1mo
Save
Mark Applied
Hide
Machine Learning Engineer III, Data
Buffalo, New York, United States
$130k-$173k/yr OnsiteFull Time
3+ YOEMS/PhD or equivalent, 3+ years computer vision experience, proficiency with PyTorch/OpenCV/TensorFlow, Python/SQL, Kafka, Docker, cloud (AWS/GCP), and experience with production model serving and microservices.
PyTorch, OpenCV, TensorFlow, Python, SQL, Kafka, Docker, AWS, GCP, Kubeflow, Databricks, KServe, REST, gRPC
1mo
Save
Mark Applied
Hide
Machine Learning Engineer, Operations Technology
Toronto, Ontario, Canada
$135k-$155k/yr HybridFull Time
Strong Python and SQL skills; experience building and maintaining production ML systems, model serving, monitoring, CI/CD, and MLOps tooling (MLFlow, Databricks, Prefect, Kubernetes). Familiarity with generative AI, LLMs, and image generation.
Python, SQL, MLFlow, Databricks, Prefect, Kubernetes, PySpark, LLMs
1w
Save
Mark Applied
Hide
ML Scientist / Machine Learning Engineer
Toronto, Ontario, Canada
$118k-$158k/yr HybridFull Time
Requires Python, AWS, Databricks, machine learning, and computer science fundamentals. Relevant focus includes ranking, personalization, MLOps, model serving, monitoring, productionization, automation, and scalability.
Python, AWS, Databricks, Zipline, JIRA