31 ml infrastructure engineer jobs at 22 companies in Sanborn, NY
1w
Save
Mark Applied
Hide
Infrastructure Engineer - Platform
Toronto, Ontario, Canada
$150k-$200k/yr OnsiteFull Time
4+ YOEBachelor's, master's, PhD, or equivalent experience; 4+ years building production cloud infrastructure; expertise in AWS or GCP, distributed ML training, inference, Terraform, Kubernetes, Docker, security, networking, and observability.
AWS, GCP, PyTorch, Terraform, Kubernetes, Docker, S3, EC2, ECR, Batch, ParallelCluster, SageMaker, GCS, Cluster Toolkit, Weights & Biases, MLflow, CVAT, Hugging Face, Kafka, Pub/Sub, Kinesis, CDNs, GitHub Actions
1mo
Save
Mark Applied
Hide
Member of Technical Staff - Machine Learning Infrastructure Engineer
San Francisco or Toronto or Seattle
$180k-$300k/yr OnsiteFull Time
Experienced software engineer with production ML/data infrastructure skills, proficiency with PyTorch or JAX, distributed systems, AWS/GCP, Kubernetes, data pipelines, and familiarity with transformers and inference libraries like vLLM.
PyTorch, JAX, AWS, GCP, Kubernetes, transformers, vLLM, SGLang
3d
Save
Mark Applied
Hide
Senior AI/ML Engineer
Lisbon or Atlanta or London or San Francisco or Santiago or Sydney or Tokyo or Toronto or Australia or Canada or United States
HybridFull Time
5+ YOE5+ years of software engineering experience building production distributed systems and AI systems, with expertise in LLMs, agents, retrieval, cloud infrastructure, containers, Kubernetes, reliability, and evaluation.
LLM, Kubernetes, AWS, GCP, Azure, LangChain, LlamaIndex, Kafka, Airflow, Spark
1mo
Save
Mark Applied
Hide
Principal Applied AI Developer, Foundation Models Infrastructure
Quebec or Toronto or Canada
$153k-$224k/yr RemoteFull Time
8+ YOE8+ years software engineering experience with large-scale cloud-native or ML infrastructure; hands-on with Kubernetes, Ray, SageMaker, AWS; experience designing production ML training/serving platforms, CI/CD, infrastructure-as-code, and mentoring engineers.
Kubernetes, Ray, SageMaker, AWS
4w
Save
Mark Applied
Hide
Software Engineer, Machine Learning Infrastructure
Toronto, Ontario, Canada
OnsiteFull Time
2+ YOE2+ years software development experience building large-scale distributed services and production ML/MLOps platforms; experience with operations, product collaboration, and shipping ML models/LLM applications.
1mo
Save
Mark Applied
Hide
Senior DevOps Engineer, AI Infrastructure
Toronto, Ontario, Canada
$130k-$145k/yr HybridFull Time
5+ YOEBachelor's in CS or related, 5+ years in DevOps/AI/ML with GenAI and LLM experience; expert Python, vector DBs, RAG pipelines, MLOps, containerization, CI/CD, and cloud skills.
Python, Qdrant, Pinecone, pgvector, LlamaIndex, LangGraph, AWS Bedrock, Agentcore, Docker, Kubernetes, CI/CD, AWS, Azure, GCP, SQL
2mo
Save
Mark Applied
Hide
ML Ops Lead
New York City or Toronto or United States or Canada
$195k-$245k/yr RemoteFull Time, Contract
Senior MLOps/data engineering experience with strong systems design, hands-on implementation of production data pipelines and ML workflows, fluency with modern data/ML stack and cloud infrastructure (SQL, Python, Airflow, dbt, AWS).
SQL, Python, Airflow, dbt, PostgreSQL, Redshift, MongoDB, AWS SageMaker, Looker, S3, Lambda, Glue
2mo
Save
Mark Applied
Hide
Senior Site Reliability Engineer, AI Infrastructure
Mississauga or Salt Lake City
$139k-$155k/yr HybridFull Time
5+ YOE5+ years SRE/platform experience; strong observability and incident response; Terraform and GitOps; cloud platform experience (Databricks, Azure ML, Kubernetes); platform security and automation skills; strong communication.
Databricks, Azure AI, Azure ML, Kubernetes, Terraform, GitOps, CI/CD
1mo
Save
Mark Applied
Hide
Engineering Manager, GPU Infrastructure
Toronto or San Francisco or New York City or London or Paris or Montreal
HybridFull Time
Experience managing engineering teams focused on GPU/ML infrastructure, Kubernetes, IaC, observability, and collaboration with AI researchers; strong communication and mentorship skills.
JAX, PyTorch, TensorFlow, Kubernetes, Prometheus, Grafana, Terraform, ArgoCD
1mo
Save
Mark Applied
Hide
Platform Engineer, AI Capability Center Hub
Chicago or Toronto
$140k-$170k/yr RemoteFull Time
5+ YOE1+ Mgmt5+ years in ML/AI platform or MLOps, 1–2 years leading, hands-on production AI systems, strong Python, experience with AWS and Azure, Docker, Kubernetes, and infrastructure as code.
AWS, Azure, Docker, Kubernetes, Python, CI/CD, infrastructure as code, AWS Machine Learning, Azure AI-102, CKA
3d
Save
Mark Applied
Hide
Senior Principal Engineer, Product Software (Network Platform)
Redwood City or Toronto or Dallas or United States or Canada
$200k-$360k/yr HybridFull Time
Significant large-scale infrastructure experience, senior architecture experience across teams, expertise in distributed software, network platforms, control systems, observability, AI/ML, and technical leadership.
AI/ML, AIOps, APIs, AI
2mo
Save
Mark Applied
Hide
Senior Software Engineer (Pipeline team)
Toronto, Ontario, Canada
OnsiteFull Time
5+ YOE5+ years software engineering experience with 2–3 years in ML engineering/MLOps; strong Python and SQL skills; experience building ML pipelines, model/versioning, experiment tracking, CI/CD for ML, monitoring, and cloud infrastructure (AWS).
AWS Bedrock, MLflow, Apache Airflow, AWS S3, AWS ECS, AWS EKS, AWS Lambda, AWS Step Functions, Python, SQL
1w
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York City or Seattle or Toronto or Santa Barbara or San Diego
$127k-$190k/yr RemoteFull Time
5+ YOE5+ years in data or software engineering; advanced Python, SQL, Databricks, Spark, and data modeling; experience with orchestration, streaming, cloud infrastructure, data quality, ML datasets, and privacy; bachelor's degree or equivalent.
Python, PySpark, Pandas, Polars, PyArrow, SQL, MySQL, PostgreSQL, Databricks, Delta Lake, Unity Catalog, Workflows, Jobs/Compute, Snowflake, BigQuery, Apache Spark, Airflow, Dagster, Kafka, Kinesis, Spark Structured Streaming, AWS, S3, IAM, FastAPI, Databricks Model Serving, SageMaker endpoints
1mo
Save
Mark Applied
Hide
Staff Machine Learning Software Engineer
Toronto or Vancouver
OnsiteFull Time
10+ YOEBachelor's in a technical field,10+ years leading ML solutions,experience managing data science/engineering teams,expertise in ML systems and production infrastructure,EMR not mentioned,excellent communication and stakeholder engagement.
2mo
Save
Mark Applied
Hide
AI Engineer - Assistant Vice President
Mississauga, Ontario, Canada
$94k-$142k/yr HybridFull Time
5+ YOERequires 5+ years in AI/ML development, expert Python, GenAI, LLMs, prompt engineering, RAG, vector databases, cloud infrastructure, MLOps, containerization, CI/CD, and strong communication skills.
Python, SQL, Transformers, LangChain, LlamaIndex, TensorFlow, PyTorch, Pandas, NumPy, Scikit-learn, Flask, Django, Docker, Kubernetes, AWS, Azure, GCP, MLflow, Kubeflow, GitHub Actions, Jenkins, Git, Tableau, Power BI, matplotlib, seaborn, Llama, Gemini, GPT-4, Pinecone, Weaviate, Chroma, Faiss, PostgreSQL, pgvector, EHR, NoSQL
3mo
Save
Mark Applied
Hide
Machine Learning Engineer, Detection
Toronto, Ontario, Canada
$112k-$262k/yr HybridFull Time
Design, train, and deploy ML models for batch and real-time inference; work on NLP, embeddings, similarity search, and anomaly detection; collaborate with Detection and Infrastructure teams to scale ML systems.
2w
Save
Mark Applied
Hide
Senior Software Developer, Machine Learning, Applied AI
Sunnyvale or Toronto or Waterloo or New York City
$174k-$252k/yr OnsiteFull Time
5+ YOE3+ MgmtBachelor's degree or equivalent, 5+ years software development and ML experience, software testing and launch expertise, ML design and infrastructure experience, and 3+ years technical leadership.
Python
4d
Save
Mark Applied
Hide
Staff Machine Learning Engineer, Generative AI (Auth0)
Toronto, Ontario, Canada
$168k-$231k/yr HybridFull Time
7+ YOERequires 7+ years of software development experience, strong Python skills, applied machine learning, GenAI platforms, RAG, AI agent frameworks, ML frameworks, evaluation pipelines, and AI/ML infrastructure expertise.
Python, Go, TypeScript, AWS Bedrock, OpenAI, Anthropic, LiteLLM, LangGraph, LangChain, LlamaIndex, MCP, FastAPI, PyTorch, TensorFlow, Spark ML, Airflow, Claude
2d
Save
Mark Applied
Hide
Job Posting Title Senior Principal Engineer, Product Software (Network Platform)
Redwood City or Toronto or Dallas or North America or North America
$166k-$360k/yr HybridFull Time
5+ YOERequires significant large-scale infrastructure experience, senior architecture leadership, AI/ML application experience, distributed software architecture expertise, network platform knowledge, and cross-team influence.
AI/ML, AIOps, APIs, SDN
1mo
Save
Mark Applied
Hide
Engineering Manager - Machine Learning
Toronto or London or Salt Lake City
$210k-$283k/yr RemoteFull Time
Hands-on technical manager/tech lead experience in MLOps, distributed systems, ML infrastructure, model deployment, GPU optimization, and mentoring engineers; familiarity with Python, PyTorch, containerization, orchestration, and cloud platforms.
Python, PyTorch, Docker, Kubernetes, Ray, Weights & Biases, Prefect, BigQuery, Postgres, GCP, CUDA
Explore Jobs