68 ai framework engineer jobs at 47 companies in Canton, MA
1mo
Save
Mark Applied
Hide
Distinguished AI Engineer (Agentic AI Platform)
San Francisco or McLean or Cambridge or San Jose or New York City
$294k-$335k/yr OnsiteFull Time
6+ YOEBachelor's or Master's in CS/Engineering/AI with 6–8+ years building and deploying scalable AI/ML systems; strong programming in Python/Go/Scala/Java and experience with agentic frameworks, cloud platforms, and LLMs.
Python, Go, Scala, Java, C++, C#, Golang, LangGraph, AutoGen, Semantic Kernal, Semantic Kernel (Microsoft), CrewAI, LlamaIndex, LangChain, AWS, Google Cloud, Azure, Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning, K8s, Helm charts, CRDs, SDK, CLI, VectorDBs, RAG, LLM Inference, Similarity Search
1w
Save
Mark Applied
Hide
Principal AI Engineer - Evinova
Cambridge, Massachusetts, United States
$145k-$190k/yr HybridFull Time
4+ YOEMaster's degree required,4+ years applied ML experience with deep learning/NLP/generative AI,expert Python and ML frameworks,experience with agentic AI and AWS services,excellent communication.
Python, TensorFlow, PyTorch, Google ADK, Crewai, LangChain, LlamaIndex, SageMaker, Bedrock, MSK, EKS, ECS, OpenSearch, C, C++, Rust, CUDA
1mo
Save
Mark Applied
Hide
Principal AI Engineer - Evinova
Waltham, Massachusetts, United States
$145k-$190k/yr HybridFull Time
4+ YOEMaster's degree, 4+ years applied ML experience with deep learning/NLP/generative AI, expertise with LLMs, Python and ML frameworks, experience with AWS services, strong communication and technical leadership ability.
Python, TensorFlow, PyTorch, Google ADK, Crewai, LangChain, LlamaIndex, SageMaker, Bedrock, MSK, EKS, ECS, OpenSearch, C/C++, Rust, CUDA
1mo
Save
Mark Applied
Hide
Senior Deep Learning Framework Communications Engineer
Santa Clara or Austin or Westford or Durham or United States
$152k-$288k/yr HybridFull Time
5+ YOE5+ years software engineering experience in HPC/AI, experience with PyTorch/JAX and inference engines, Python/C++/CUDA development, performance benchmarking and profilers, understanding of multi-GPU communication and compilers.
PyTorch, TRT-LLM, vLLM, SGLang, JAX, NCCL, NVSHMEM, GPUDirect, torch.compile, PyTorch profiler, NVIDIA Nsight Systems, Python, C++, CUDA, Triton, cuTe, MPI
1w
Save
Mark Applied
Hide
Senior AI Engineer
Boston or Jersey City or New York City
$175k-$215k/yr OnsiteFull Time
5+ YOE5+ years software engineering with 1+ year production GenAI/LLM experience; shipped AI features; experience with LLM APIs, RAG, agentic frameworks; strong Python and cloud experience.
Anthropic Claude, OpenAI, Agno, LangChain, LlamaIndex, Python, Azure, AWS, Pinecone, Weaviate, pgvector, Temporal
1mo
Save
Mark Applied
Hide
AI Developer, AVP
Burlington, Massachusetts, United States
$90k-$158k/yr OnsiteFull Time
2+ YOEHands-on engineer with 2+ years building production AI systems: LLMs, RAG, agent frameworks, Python (plus Java/C#/TypeScript), cloud platforms (Azure preferred), Kafka/Event Hub, Redis/Hazelcast, and CI/CD practices.
LLMs, RAG, MCP, Python, Java, C#, TypeScript, Kafka, Event Hub, Redis, Hazelcast, Snowflake, Microsoft Azure, AWS, GCP, API Management, APIs, CI/CD, Agile, Scrum
1mo
Save
Mark Applied
Hide
AI Platform Engineer
Boston or Springfield
$134k-$176k/yr HybridFull Time
2+ YOE2+ years platform/infrastructure/SRE experience; cloud-native experience (AWS, GCP, or Azure); delivered platform features to production; experience with IaC and GitOps (Terraform or Pulumi, ArgoCD); familiarity with Kubernetes and LLM serving frameworks.
AWS, GCP, Azure, Terraform, Pulumi, ArgoCD, Kubernetes, vLLM, Triton, Ray Serve, Degreed
2mo
Save
Mark Applied
Hide
Senior AI Engineer
Chicago or Miami or New York City or Oakbrook Terrace or Nashville or South Bend or Tampa or Atlanta or Boston or Dallas or Houston or Grand Rapids or Austin or Charlotte or Indianapolis
$74k-$148k/yr OnsiteFull Time
4+ YOE4–6 years AI/ML engineering; strong Python, cloud, distributed systems; deep learning frameworks; VMs and containerization; experience with LLMs and vector databases; travel up to 80%
Python, ML frameworks, AWS, Azure, Google Cloud, Docker, Kubernetes, Terraform, SageMaker, Vertex AI, Azure ML, GPU/accelerator workflows, PyTorch, TensorFlow, Hugging Face, LangChain, LlamaIndex, Pinecone, Weaviate, FAISS, OpenAI API, Azure OpenAI, Gemini, PEFT, LoRA, QLoRA, Power Platform, APIs, SDKs
3w
Save
Mark Applied
Hide
AI Platform Engineer
Somerville, Massachusetts, United States
$100k-$155k/yr HybridFull Time
5+ YOE5+ years building AI/LLM solutions, Bachelor's in CS/Engineering or equivalent, production experience with LLMs, agent frameworks, RAG, prompt engineering, Typescript, RESTful APIs, AWS/GCP, and CI/CD; strong communication and product judgment.
Typescript, RESTful, LLM, RAG, AWS, GCP, CI/CD
1mo
Save
Mark Applied
Hide
Lead AI Security Engineer
Johnston, Rhode Island, United States
$121k-$173k/yr HybridFull Time
7+ YOE7+ years in IT or cybersecurity (including 5+ years in security engineering); hands-on security engineering for cloud, APIs, identity, data protection and monitoring; practical AI/LLM security knowledge; experience defining security requirements and frameworks.
Microsoft Copilot, Claude, Azure AI Foundry, Azure, NIST Risk Management Framework, MITRE ATLAS, OWASP Top 10, OWASP guidance for large language model applications
1mo
Save
Mark Applied
Hide
Principal AI Engineer - Evinova
Waltham, Massachusetts, United States
$145k-$190k/yr HybridFull Time
4+ YOEMaster's degree required, 4+ years applied ML experience with deep learning/NLP/LLMs, expert Python, experience with ML frameworks and AWS services, agentic AI and multi-agent system expertise, strong communication.
Python, TensorFlow, PyTorch, Google ADK, Crewai, LangChain, LlamaIndex, SageMaker, Bedrock, MSK, EKS, ECS, OpenSearch, C/C++, Rust, CUDA
1mo
Save
Mark Applied
Hide
AI Systems Engineer
Boston, Massachusetts, United States
OnsiteFull Time
Experience with AI inference and distributed serving, strong systems and GPU optimization skills, proficiency in Python and PyTorch, familiarity with inference frameworks (vLLM, Triton, Ray Serve); PhD or equivalent experience preferred.
vLLM, PyTorch, Triton inference server, Ray Serve, CUDA, Python
3w
Save
Mark Applied
Hide
Associate Director, AI Software Security Engineer
McKinney or Tewksbury or Tucson
$157k-$299k/yr OnsiteFull Time
12+ YOEU.S. citizen with ability to obtain/maintain TS/SCI clearance, STEM degree, ~12+ years experience deploying AI/LLMs, secure MLOps/DevSecOps, cloud (AWS/Azure/GCP), Python, ML frameworks, and leadership experience.
Amazon Web Services (AWS), Azure, Google Cloud Platform (GCP), Python, Large Language Models (LLMs)
4w
Save
Mark Applied
Hide
Agentic AI Engineer (Boston, Hybrid)
Boston, Massachusetts, United States
$319k-$350k/yr HybridFull Time
Deep experience building and deploying LLM-powered or agentic systems, full-stack engineering with JS/TS and Python, API and cloud platform experience, AI orchestration frameworks knowledge, strong product and UX sensibility.
JavaScript, TypeScript, Python, REST, GraphQL, AWS, GCP, Azure, LangChain, LlamaIndex, AutoGen, CrewAI
1d
Save
Mark Applied
Hide
Lead AI / ML Engineer
New York City or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$294k/yr HybridFull Time
6+ YOEBachelor's degree or equivalent experience, 6+ years developing and deploying AI/ML solutions, programming proficiency, experience with ML frameworks, big data, databases, and cloud platforms.
Python, R, Java, TensorFlow, PyTorch, Hadoop, Spark, AWS, Microsoft Azure, Google Cloud, D3.js, ggplot
1d
Save
Mark Applied
Hide
Principal AI/ML Research Engineer
United States or California or San Jose or Seattle or Portland or Boston or Chicago
$250k-$289k/yr RemoteFull Time
12+ YOE12+ years in software or ML engineering, including 5+ years in applied AI/ML research. Requires advanced expertise in model architecture, algorithms, Python, deep learning frameworks, distributed AI, cloud, and ML platforms.
Python, PyTorch, TensorFlow, JAX, C++, Java, Ray, DeepSpeed, Megatron, Spark, AWS, Azure, SageMaker, MLflow, Databricks, LanceDB, Pinecone, Qdrant, Milvus, Transformer, Tabular Transformers, LLMs, RAG, LoRA, PEFT, Diffusion, Reinforcement Learning, RLHF, NeurIPS, ICML, KDD, ACL
1mo
Save
Mark Applied
Hide
Senior Engineer, AI/ML Software
Boston, Massachusetts, United States
$178k-$216k/yr HybridFull Time
3+ YOEMaster's in a related technical field and 3+ years building and deploying AI/ML solutions; expertise in cloud platforms, Python and complementary languages, modern ML frameworks, containerization, databases, and software engineering best practices.
Azure, AWS, GCP, Python, JavaScript, C/C++, LangChain, LangGraph, LlamaIndex, PyTorch, scikit-learn, XGBoost, SQL, NoSQL, PostgreSQL, pgvector, Docker, Kubernetes
4w
Save
Mark Applied
Hide
Sr. Security Engineer (AI)
Boston, Massachusetts, United States
$121k-$226k/yr HybridFull Time
5+ YOE5+ years security engineering experience with hands-on AI/ML systems; strong Python and AWS security knowledge; experience securing LLMs, agent frameworks, threat modeling, red-teaming, and mapping controls to compliance frameworks.
Python, AWS, LLM, SOC 2, ISO 27001, ISO 42001, NIST AI RMF
2mo
Save
Mark Applied
Hide
BCG Platinion | Lead AI Tech Architect - AI Platforms
Atlanta or Austin or Boston or Brooklyn or Chicago or Dallas or Denver or Detroit or Durham or Houston or Miami or Minneapolis or Nashville or New York or Philadelphia or Pittsburgh or Summit or Washington
$190k/yr OnsiteFull Time
6+ YOEBachelor's in CS/IT or related,6+ years in software/data/AI systems with architecture or technical leadership, experience designing LLM/AI platform solutions, cloud and containerization experience, proficiency with Python/JS/TypeScript and AI frameworks.
LangChain, LlamaIndez, LangGraph, Strands, Google ADK, Semantic Kernel, AutoGen, LlamaIndex, Python, Javascript, TypeScript, Cursor, Claude Code, Replit, Lovable, RAG, Docker, Kubernetes, Pinecone, Qdrant, Aure Search, ChatGPT, Claude, AWS, Azure, GCP
2mo
Save
Mark Applied
Hide
Principal Engineer - AI Engineering
Niskayuna or Cambridge
$132k-$219k/yr OnsiteFull Time
7+ YOE7+ years in computer science/AI with experience in prompt engineering, Python, ML frameworks; willing to work in Niskayuna, NY or Cambridge, MA; master’s/PhD preferred.
GPT models, Hugging Face, Python, PyTorch, Pandas, NumPy, Git
Explore Jobs