26 ml infrastructure engineer jobs at 18 companies in Newfane, NY
3w
Save
Mark Applied
Hide
Member of Technical Staff - Machine Learning Infrastructure Engineer
San Francisco or Toronto or Seattle
$180k-$300k/yr OnsiteFull Time
Experienced software engineer with production ML/data infrastructure skills, proficiency with PyTorch or JAX, distributed systems, AWS/GCP, Kubernetes, data pipelines, and familiarity with transformers and inference libraries like vLLM.
PyTorch, JAX, AWS, GCP, Kubernetes, transformers, vLLM, SGLang
1mo
Save
Mark Applied
Hide
Principal Applied AI Developer, Foundation Models Infrastructure
Quebec or Toronto or Canada
$153k-$224k/yr RemoteFull Time
8+ YOE8+ years software engineering experience with large-scale cloud-native or ML infrastructure; hands-on with Kubernetes, Ray, SageMaker, AWS; experience designing production ML training/serving platforms, CI/CD, infrastructure-as-code, and mentoring engineers.
Kubernetes, Ray, SageMaker, AWS
2mo
Save
Mark Applied
Hide
Software Engineer, ML Data Infrastructure
Toronto or New York City
OnsiteFull Time
2+ YOE2+ years building large-scale distributed systems, strong fundamentals in data structures, algorithms, databases, and large-scale data processing; experience with Python, Kubernetes, GCP, and related data infra is helpful.
Python, Kubernetes, GCP, Google Bigtable, Google BigQuery, Google Spanner, Google Pub/Sub, Docker, Terraform, TPU infrastructure
2w
Save
Mark Applied
Hide
Software Engineer, Machine Learning Infrastructure
Toronto, Ontario, Canada
OnsiteFull Time
2+ YOE2+ years software development experience building large-scale distributed services and production ML/MLOps platforms; experience with operations, product collaboration, and shipping ML models/LLM applications.
3w
Save
Mark Applied
Hide
Senior Machine Learning Engineer — Data Infrastructure
Toronto or Zürich or California
HybridFull Time
5+ YOE5+ years in data engineering or similar with distributed systems, production ingestion at scale, Python and SQL proficiency, ETL/ELT for ML, cloud object storage experience, and experience with data-processing frameworks.
Python, SQL, PySpark, Pandas, Ray, Spark, Dask, OpenCV, Pillow, scikit-image, AWS S3, GCP GCS, Airflow, Dagster, Prefect, COCO, PASCAL VOC, YOLO, DVC, LakeFS, Docker, Kubernetes
1mo
Save
Mark Applied
Hide
Senior DevOps Engineer, AI Infrastructure
Toronto, Ontario, Canada
$130k-$145k/yr HybridFull Time
5+ YOEBachelor's in CS or related, 5+ years in DevOps/AI/ML with GenAI and LLM experience; expert Python, vector DBs, RAG pipelines, MLOps, containerization, CI/CD, and cloud skills.
Python, Qdrant, Pinecone, pgvector, LlamaIndex, LangGraph, AWS Bedrock, Agentcore, Docker, Kubernetes, CI/CD, AWS, Azure, GCP, SQL
2mo
Save
Mark Applied
Hide
ML Ops Lead
New York City or Toronto or United States or Canada
$195k-$245k/yr RemoteFull Time, Contract
Senior MLOps/data engineering experience with strong systems design, hands-on implementation of production data pipelines and ML workflows, fluency with modern data/ML stack and cloud infrastructure (SQL, Python, Airflow, dbt, AWS).
SQL, Python, Airflow, dbt, PostgreSQL, Redshift, MongoDB, AWS SageMaker, Looker, S3, Lambda, Glue
3w
Save
Mark Applied
Hide
Engineering Manager, GPU Infrastructure
Toronto or San Francisco or New York City or London or Paris or Montreal
HybridFull Time
Experience managing engineering teams focused on GPU/ML infrastructure, Kubernetes, IaC, observability, and collaboration with AI researchers; strong communication and mentorship skills.
JAX, PyTorch, TensorFlow, Kubernetes, Prometheus, Grafana, Terraform, ArgoCD
2mo
Save
Mark Applied
Hide
Senior Principal Engineer, Product Software
Redwood City or Toronto or Dallas Infomart Office DAI
HybridFull Time
Experience in large-scale infrastructure, senior architecture, AI/ML in infrastructure, cloud-native distributed systems, and cross-team leadership.
Cloud-native, Telemetry, Observability, AI/ML, Programming
2w
Save
Mark Applied
Hide
Software Engineer, Machine Learning Infrastructure
Canada or Toronto
$172k-$258k/yr HybridFull Time
2+ YOE2+ years software development experience with service-oriented architecture, distributed systems, production ML platforms or MLOps, operations for high-availability systems, and cross-team collaboration.
1mo
Save
Mark Applied
Hide
Senior Staff Machine Learning Platform Engineer
San Francisco or Waterloo or Toronto
$295k-$406k/yr HybridFull Time
10+ YOE10+ years building large-scale ML/data platforms; expertise with Databricks lakehouse, Unity Catalog, Spark, MLflow; strong distributed systems, cloud, and ML infrastructure experience; graduate-level degree preferred.
Python, SQL, Kotlin, PyTorch, PySpark, MLFlow, Spark, Kafka, Databricks, Snowflake, Fivetran, Iceberg, Unity Catalog, Datadog, Airflow, Cockroach DB, MySQL, AWS, S3, SageMaker, Kubernetes, Docker, GitHub Actions, Terraform, Claude Sonnet 4.5, ChatGPT 5.2
1mo
Save
Mark Applied
Hide
Platform Engineer, AI Capability Center Hub
Chicago or Toronto
$140k-$170k/yr RemoteFull Time
5+ YOE1+ Mgmt5+ years in ML/AI platform or MLOps, 1–2 years leading, hands-on production AI systems, strong Python, experience with AWS and Azure, Docker, Kubernetes, and infrastructure as code.
AWS, Azure, Docker, Kubernetes, Python, CI/CD, infrastructure as code, AWS Machine Learning, Azure AI-102, CKA
2mo
Save
Mark Applied
Hide
Senior Software Engineer (Pipeline team)
Toronto, Ontario, Canada
OnsiteFull Time
5+ YOE5+ years software engineering experience with 2–3 years in ML engineering/MLOps; strong Python and SQL skills; experience building ML pipelines, model/versioning, experiment tracking, CI/CD for ML, monitoring, and cloud infrastructure (AWS).
AWS Bedrock, MLflow, Apache Airflow, AWS S3, AWS ECS, AWS EKS, AWS Lambda, AWS Step Functions, Python, SQL
6h
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York City or Seattle or Toronto or Santa Barbara or San Diego
$127k-$190k/yr RemoteFull Time
5+ YOE5+ years in data or software engineering; advanced Python, SQL, Databricks, Spark, and data modeling; experience with orchestration, streaming, cloud infrastructure, data quality, ML datasets, and privacy; bachelor's degree or equivalent.
Python, PySpark, Pandas, Polars, PyArrow, SQL, MySQL, PostgreSQL, Databricks, Delta Lake, Unity Catalog, Workflows, Jobs/Compute, Snowflake, BigQuery, Apache Spark, Airflow, Dagster, Kafka, Kinesis, Spark Structured Streaming, AWS, S3, IAM, FastAPI, Databricks Model Serving, SageMaker endpoints
3w
Save
Mark Applied
Hide
Staff Machine Learning Software Engineer
Toronto or Vancouver
OnsiteFull Time
10+ YOEBachelor's in a technical field,10+ years leading ML solutions,experience managing data science/engineering teams,expertise in ML systems and production infrastructure,EMR not mentioned,excellent communication and stakeholder engagement.
3mo
Save
Mark Applied
Hide
Machine Learning Engineer, Detection
Toronto, Ontario, Canada
$112k-$262k/yr HybridFull Time
Design, train, and deploy ML models for batch and real-time inference; work on NLP, embeddings, similarity search, and anomaly detection; collaborate with Detection and Infrastructure teams to scale ML systems.
5d
Save
Mark Applied
Hide
Senior Software Developer, Machine Learning, Applied AI
Sunnyvale or Toronto or Waterloo or New York City
$174k-$252k/yr OnsiteFull Time
5+ YOE3+ MgmtBachelor's degree or equivalent, 5+ years software development and ML experience, software testing and launch expertise, ML design and infrastructure experience, and 3+ years technical leadership.
Python
13h
Save
Mark Applied
Hide
AI Systems Engineer – AI Model (Training & Inference)
Markham, Ontario, Canada
$132k-$198k/yr HybridFull Time
Experience shipping production AI/ML infrastructure across training and inference, GPU kernel optimization, distributed GPU systems, and AMD Instinct hardware. A technical degree is preferred.
Kubernetes, FSDP, DeepSpeed, Megatron-LM, RCCL, HIP, Triton, MLIR, vLLM, SGLang, TorchServe, ROCm, PyTorch, GPTQ, AWQ
3w
Save
Mark Applied
Hide
Engineering Manager - Machine Learning
Toronto or London or Salt Lake City
$210k-$283k/yr RemoteFull Time
Hands-on technical manager/tech lead experience in MLOps, distributed systems, ML infrastructure, model deployment, GPU optimization, and mentoring engineers; familiarity with Python, PyTorch, containerization, orchestration, and cloud platforms.
Python, PyTorch, Docker, Kubernetes, Ray, Weights & Biases, Prefect, BigQuery, Postgres, GCP, CUDA
2mo
Save
Mark Applied
Hide
Senior Principal Engineer, Product Software (Network Platform)
Redwood City or Toronto or Dallas or Redwood City or Toronto or Dallas
HybridFull Time
Significant large-scale infrastructure experience, senior architecture experience, distributed software architecture expertise, network and observability knowledge, AI/ML experience, and strong cross-functional communication skills.
AI/ML, AIOps, APIs, AI
Explore Jobs