314 llm engineer jobs at 170 companies in Lockport, NY
2w
Save
Mark Applied
Hide
AI Developer (LLM & Agentic Systems)
Toronto or Calgary or Vancouver
$94k-$138k/yr OnsiteFull Time
5+ YOE5+ years software development experience with 2+ years designing and deploying LLM or agentic AI systems; degree in CS/software engineering; experience with embeddings, vector search, RAG, cloud-native development (Azure), and CI/CD.
LLMs, RAG, embeddings, vector search, Python, FastAPI, Node.js, Azure, SPARQL, Cypher, Docker, Kubernetes, Git, CI/CD
1w
Save
Mark Applied
Hide
AI Developer - LLM Features & AI Systems
Toronto, Ontario, Canada
$85k-$120k/yr OnsiteFull Time
Experience building production RAG systems, embedding and vector DB expertise, agent/workflow development, TypeScript and Python proficiency, familiarity with Claude/OpenAI APIs and LLM evaluation.
Pinecone, Weaviate, Chroma, MongoDB, Claude API, OpenAI API, LangChain, LlamaIndex, Claude Code, TypeScript, Python, Node.js, AWS, Cohere, RAGAS, GitHub
1w
Save
Mark Applied
Hide
DL Performance Software Engineer - LLM Inference
Toronto, Ontario, Canada
$135k-$220k/yr HybridFull Time
5+ YOEBachelor’s, Master’s, or PhD in computer science, computer engineering, or software engineering; 5+ years’ software or equivalent research experience; Python and C/C++, Go, or Rust; GPU and ML systems expertise.
Python, C, C++, Go, Rust, vLLM, PyTorch, SGLang, CUDA, NCCL, Nsight Systems, Nsight Compute, Triton, CuTe, MLIR, LLVM, XLA, CUTLASS, CUDA Graph, Tensor Cores
1w
Save
Mark Applied
Hide
DL Performance Software Engineer - LLM Inference
Toronto, Ontario, Canada
$135k-$220k/yr HybridFull Time
5+ YOEBachelor's, master's, or PhD in computer science, computer engineering, or software engineering; 5+ years' software or research experience; Python plus C/C++, Go, or Rust; GPU, ML systems, and distributed systems expertise.
Python, C, C++, Go, Rust, vLLM, NVIDIA GPU, PyTorch, SGLang, CUDA, NCCL, Nsight Systems, Nsight Compute, Triton, CuTe, MLIR, LLVM, XLA, CUTLASS, CUDA Graph, Tensor Cores, GitHub
2mo
Save
Mark Applied
Hide
Technical Support Engineer
Toronto, Ontario, Canada
$100k-$125k/yr HybridFull Time
4+ YOE4+ years in technical support, systems engineering, or software development; mastery of Python/JavaScript/Java/Ruby; deep systems and distributed tracing knowledge; familiarity with LLM orchestration and AI tooling; exceptional communication.
Python, JavaScript, Java, Ruby, React, GitHub, Discord, CI/CD, SDKs, APIs, Model Context Protocol (MCP), Sentry, Seer, LLM, RAG
1mo
Save
Mark Applied
Hide
Senior Frontend Engineer, Platform
San Francisco or Toronto or United States or Canada
$190k-$249k/yr RemoteFull Time
5+ YOE5+ years engineering experience, building production-quality software; ownership of projects end-to-end; experience with frontend systems for deploying LLM-based algorithms; strong communication, mentoring, and cross-team collaboration skills.
LLM, Kubernetes
2w
Save
Mark Applied
Hide
Forward Deployed Engineer
Toronto, Ontario, Canada
$100k-$140k/yr OnsiteFull Time
3+ YOE3+ years building production SaaS; hands-on customer support and debugging; experience with LLM-powered features, Python/TypeScript/SQL, strong communication and prioritization.
FastAPI, Python, Next.js, TypeScript, SQL, Postgres, LLM
3w
Save
Mark Applied
Hide
Forward Deployed Engineer
Toronto, Ontario, Canada
FieldFull Time
Experience delivering production AI systems, strong AI/ML and LLM practical skills, backend development in Python or Java, client-facing communication, and ability to work autonomously in healthcare settings.
AI Management System (AIMS), Python, Java, LLM
1mo
Save
Mark Applied
Hide
Principal Engineer, AI & Emerging Technology
Toronto, Ontario, Canada
OnsiteFull Time
10+ YOEUniversity degree in computer science/engineering; 10+ years software engineering experience; proven leadership of AI/GenAI initiatives; expertise with LLMs, LangChain, LlamaIndex, Amazon Bedrock, AWS, Terraform, Docker, Kubernetes, Python, Airflow, and web frameworks.
OpenAI, Anthropic, Google, LLMs, LangChain, LlamaIndex, Amazon Bedrock, Model Context Protocol (MCP), GraphRAG, AWS, EKS, Fargate, Lambda, Athena, Glue, Lake Formation, Terraform, Puppet, Docker, Kubernetes, Next.js, React, TypeScript, Python, Apache Airflow, DAGs, NumPy, Pandas, Boto3, Ragas, Playwright, Selenium, JIRA, Confluence, JIRA Align, QuickSight, Tableau
2w
Save
Mark Applied
Hide
Senior Engineer, Data
Canada or Toronto
RemoteFull Time
8+ YOE8+ years data engineering experience building cloud-native data and ML platforms, strong Python and ML foundations, production ML pipelines, distributed systems, and experience with LLM/agentic systems.
Python, Django, Clickhouse, MySQL, MongoDB, ElasticSearch, Redshift, Airflow, Dagster, pandas, scikit-learn, PyTorch, TensorFlow, Claude Code
3d
Save
Mark Applied
Hide
Principal Engineer (Remote)
Toronto or Ottawa
RemoteFull Time
12+ YOERequires 12–18 years of software engineering experience, distributed systems and backend architecture expertise, multi-team technical leadership, and experience in fintech, payments, or regulated technology.
AWS, GCP, Microsoft Azure, AI agents, LLM, machine learning, blockchain, stablecoins, APIs, microservices
2mo
Save
Mark Applied
Hide
Principal AI Platform Engineer
San Francisco or Toronto or Montreal or United States or Canada
RemoteFull Time
10+ YOE10+ years software engineering experience, 3+ years building ML/LLM systems, strong Python backend skills, platform engineering and developer-experience experience, technical leadership at Principal level.
Python, MCP, LangGraph, LlamaIndex, Langfuse, LangSmith, Braintrust
2mo
Save
Mark Applied
Hide
Senior Software Engineer, Internal Developer Platform - PA143
Toronto, Ontario, Canada
$161k-$242k/yr OnsiteFull Time
5+ YOEExpertise with TypeScript/Node.js, REST and GraphQL APIs, Backstage, PostgreSQL/Redis, Kubernetes (GKE) and GCP, ArgoCD/Helm/GitHub Actions, Terraform; experience integrating LLMs; Bachelor's in CS and 5+ years of software engineering.
TypeScript, Node.js, REST, GraphQL, Backstage, PostgreSQL, Redis, MongoDB, Kubernetes (GKE), GCP, ArgoCD, Helm, GitHub Actions, Terraform, Datadog, LLMs, MCP
1w
Save
Mark Applied
Hide
Senior/Lead Quality Engineer - Chatbot
Edinburgh or Manchester or Ireland or Stockholm or Dublin or Amsterdam or Toronto or London or Barcelona or Europe or North America
RemoteFull Time
Mimica: Automates enterprise process discovery and mapping using artificial intelligence.
Experienced quality engineer with hands-on test automation and SDET skills, experience testing conversational AI/LLM systems preferred, programming proficiency, strong communication and collaboration.
3w
Save
Mark Applied
Hide
Lead Machine Learning Engineer
Toronto or Montreal or San Francisco
HybridFull Time
8+ YOE8+ years ML/AI engineering with technical lead experience, productionizing LLM/agent systems, monitoring and reliability, strong ML fundamentals, and people leadership.
LLMs, transformers, RAG, APIs
1mo
Save
Mark Applied
Hide
Principal AI Engineer
Toronto, Ontario, Canada
$306k-$384k/yr OnsiteFull Time
8+ YOE8+ years engineering experience; strong backend skills (Python preferred); experience with distributed systems, event-driven architectures, orchestration, evaluation frameworks, LLMs/agents, and tooling like Kafka or Pub/Sub; strong mentoring and leadership skills.
Python, Kafka, Pub/Sub, vector databases, RAG, LLMs, ChatGPT, Claude, Granola
2mo
Save
Mark Applied
Hide
Senior Software Engineer, AI (Spain)
Spain or Toronto
€111k-€143k/yr RemoteFull Time
5+ YOE5+ years backend engineering experience, hands-on LLM/AI agent experience, strong API and system integration skills, product-minded, proven ownership in ambiguous environments.
Golang, Ruby on Rails, Javascript, Java, C#, Python, VueJS, MySQL, Kafka, AWS, Git, Memcache, Redis, ElasticSearch, Docker, Terraform, Kubernetes, CircleCI, DataDog
1w
Save
Mark Applied
Hide
Staff Forward Deployed Engineer
North America or Santa Clara or Austin or Toronto
$100k-$500k/yr RemoteFull Time
5+ YOE5+ years of software engineering experience; customer-facing problem solving; Kubernetes and Helm at cluster scale; observability, infrastructure automation, and LLM inference serving experience.
RISC-V, Kubernetes, Helm, Prometheus, Grafana, OpenTelemetry, vLLM, SGLang, Mooncake, NIM, Dynamo, LMCache
3w
Save
Mark Applied
Hide
Principal Engineer
Eagan or Frisco or New York City or Toronto or Ann Arbor or San Francisco or Los Angeles or Irvine or McLean or Washington
$159k-$295k/yr HybridFull Time
Expertise in identity and access management, distributed systems, and AI/LLM integration; deep Python experience; cloud (AWS) and relational DB (PostgreSQL); strong communication and architecture ownership skills.
Python, FastAPI, PostgreSQL, AWS, Okta, Auth0, Entra ID/Azure AD, AWS Cognito, Anthropic, OpenAI, vector databases, SAML, OIDC, OAuth 2.0, RBAC/ABAC, MCP, LLMs
3w
Save
Mark Applied
Hide
Senior Engineer, AI Native SDLC (264250)
Toronto, Ontario, Canada
OnsiteFull Time
7+ YOE7+ years software engineering experience; SDLC framework design and governance; production LLM and RAG systems; strong coding in TypeScript/JavaScript or Python; GitHub Actions and cloud (Azure) experience; documentation and enablement skills.
GitHub Actions, GitHub Copilot, TypeScript, JavaScript, Python, MCP servers, Azure, Docker, Kubernetes, devContainers
Explore Jobs