22 llmops engineer jobs at 9 companies in Waltham, MA

4w
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Berwyn or Princeton or Clifton
$90k-$158k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, APIs, MLOps, LLMOps, RAG
1mo
Save
Mark Applied
Hide
Senior. Distinguished AI Engineer (Agentic AI Platform)
San Francisco or McLean or Cambridge or San Jose or New York
$343k-$392k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
8+ YOEMaster's + 8 years or Bachelor's + 10 years in AI/ML; deep software engineering skills; experience with agentic frameworks, LLMOps, cloud platforms, Kubernetes, and mentoring/architecting large-scale AI systems.
Python, Go, Golang, Scala, Java, C++, C#, LangGraph, AutoGen, Semantic Kernel (Microsoft), Semantic Kernel, LangChain, CrewAI, LlamaIndex, LLMOps, Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning, AWS, Google Cloud, Azure, K8s, Helm, CRDs, CLI, SDK, VectorDBs
1mo
Save
Mark Applied
Hide
Senior. Distinguished AI Engineer - Agentic AI Platform (Remote Eligible)
San Francisco or McLean or New York City or San Jose or United States or Cambridge
$286k-$392k/yr RemoteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
10+ YOEBachelor's degree plus 10 years or master's plus 8 years developing AI/ML technologies; 10 years programming; experience with scalable AI platforms, agentic frameworks, LLMOps, Kubernetes, and technical leadership.
Python, Go, Scala, Java, AWS, Google Cloud, Azure, LangGraph, AutoGen, Semantic Kernel, CrewAI, LlamaIndex, Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning, C++, C#, Golang, Helm, Kubernetes, CRDs, LLM Inference, VectorDBs, K8s
1d
Save
Mark Applied
Hide
AI Engineering & Platform Leadership Senior Manager - Utilities
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$113k-$338k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
10+ YOE5+ MgmtRequires 10+ years in software or AI/ML engineering, 6+ years architecting enterprise AI platforms, leadership experience, multi-cloud and LLMOps expertise, utilities experience, and a bachelor's degree or equivalent.
OpenAI, Anthropic, AWS, Azure, Google, LLMOps, MLOps, FinOps
2w
Save
Mark Applied
Hide
Senior Cloud Ops and Dev Ops Engineer
Cambridge or Plymouth Meeting or United States
OnsiteFull Time
ConcertAI
ConcertAI: AI-powered precision medicine and real-world data analytics.
4+ YOE4+ years operating data management solutions on cloud, experience with AWS services, CI/CD, Terraform, database technologies, HIPAA-aware data handling, and onshore/offshore collaboration.
Jenkins, GitHub Actions, Terraform, S3, EFS, EC2, RDS, EKS, Glue, Secrets Manager, AWS Batch, PostgreSQL, MongoDB, Redshift, Elasticsearch, Spark, Bash, Git, LLMOps, GenAI LLM
4w
Save
Mark Applied
Hide
Senior. Distinguished AI Engineer - Agentic AI Platform (Remote Eligible)
San Francisco or McLean or New York City or San Jose or Cambridge or United States
$286k-$392k/yr RemoteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
10+ YOEBachelor's degree plus 10 years or master's degree plus 8 years in AI/ML, and 10 years programming with Python, Go, Scala, or Java; cloud AI, agentic frameworks, LLMOps, and ML platform experience preferred.
Python, Go, Scala, Java, AWS, Google Cloud, Azure, LangChain, CrewAI, Semantic Kernel, Microsoft, AutoGen, Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning, C++, C#, Golang, Helm, K8s, LlamaIndex, LangGraph, LlamaIndex
2mo
Save
Mark Applied
Hide
Manager, AI Engineering - AI & Business Tech Engineering
Boston or Cambridge or United States
$180k-$200k/yr RemoteFull Time
DigitalOcean
DigitalOceanNew York Stock Exchange: DOCN: Simplifies cloud infrastructure for developers, startups, and SMBs.
Experienced engineering manager with hands-on AI/ML and LLM systems knowledge, expertise in agents/LLMOps, platform design, hiring/coaching engineers, and partnering with business stakeholders.
LangGraph, AutoGen, CrewAI, Model Context Protocol (MCP), MCP gateway, Cursor, Claude, Claude Code, GitHub Copilot, Workday, Salesforce, NetSuite, Greenhouse, Python, Go, TypeScript, Java, Kubernetes, serverless, gRPC
4d
Save
Mark Applied
Hide
AI Software Engineer III
Marlborough or Arden Hills or Boston
$82k-$156k/yr HybridFull Time
Boston Scientific
Boston ScientificNYSE: BSX: Developing and manufacturing innovative medical devices for less-invasive treatments.
Requires a bachelor's or master's degree in a technical field, AI/LLM solution deployment, distributed processing, APIs, Azure or AWS, and modern data platform experience.
Python, Celery, Kafka, SQS, RabbitMQ, Redis, Azure, AWS, LangGraph, Semantic Kernel, AutoGen, CrewAI, MLOps, LLMOps
3d
Save
Mark Applied
Hide
Snowflake Advanced AI Engineer,
San Francisco or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$70k-$206k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOERequires 2+ years with Snowflake Cortex AI, 3+ years deploying machine learning models, 3+ years in computer science and programming, cloud AI/ML deployment, and a bachelor's degree or equivalent experience.
Snowflake Cortex AI, Cortex Agents, Cortex Analyst, Cortex Search, Deep Learning, Generative AI, Large Language Models, DevOps, MLOps, LLMOps, Python, TensorFlow, PyTorch, C++, Java, R, SQL
1d
Save
Mark Applied
Hide
Sr. AI Analytics Engineer
Marlborough or El Paso or Dallas or Arlington or Plano
HybridFull Time
Helen of Troy
Helen of TroyNASDAQ: HELE: Designs and markets branded consumer housewares and personal care products.
8+ YOEBachelor's degree and 8+ years delivering enterprise analytics, BI, data, cloud, software, automation, or AI solutions; 2+ years hands-on GenAI delivery; Python, SQL, Azure AI, and Power BI expertise.
Azure AI Foundry, Copilot Studio, Azure OpenAI, Microsoft 365, Microsoft Graph, Azure AI Search, Power BI, Python, SQL, Snowflake, Model Context Protocol (MCP), Semantic Kernel, LangChain, LangGraph, Microsoft Fabric, Power Platform, Power Automate, Logic Apps, Azure DevOps, CI/CD, MLOps, LLMOps, Jupyter Notebooks, Microsoft Fabric Notebooks, PySpark, Spark, Cortex, Cortex Analyst, Cortex Search, Snowpark, Snowflake ML, Snowflake Intelligence
4d
Save
Mark Applied
Hide
Senior AI Solution Architect
Arden Hills or Marlborough
$107k-$203k/yr HybridFull Time
Boston Scientific
Boston ScientificNYSE: BSX: Developer and manufacturer of innovative medical devices and therapies.
5+ YOEBachelor's or master's degree in a technical field and 5+ years in solution or software architecture or AI/ML engineering, with generative AI, LLM, cloud, data platform, and regulated-industry experience.
Azure, AWS, Snowflake, LangGraph, Semantic Kernel, AutoGen, CrewAI, MLOps, LLMOps
4d
Save
Mark Applied
Hide
Senior AI Solution Architect
Marlborough or Arden Hills
$107k-$203k/yr HybridFull Time
Boston Scientific
Boston ScientificNYSE: BSX: Manufacturer of interventional medical devices and technologies.
5+ YOEBachelor’s or master’s degree in a technical field and 5+ years in solution or software architecture or AI/ML engineering, with generative AI, LLM, cloud, regulated-industry, and enterprise architecture experience.
Azure, AWS, Snowflake, LangGraph, Semantic Kernel, AutoGen, CrewAI, MLOps, LLMOps
1d
Save
Mark Applied
Hide
Senior Analyst, Advanced Analytics: Auto Physical Damage (APD)
Boston or Portsmouth or Seattle or Columbus or Plano
HybridFull Time
Liberty Mutual
Liberty Mutual: Provider of global property and casualty insurance products.
3+ YOEBachelor's degree or equivalent experience; 3+ years in analytics, data science, ML engineering, or related work; proficiency in SQL and Python; machine learning, dashboarding, communication, and analytical skills.
SQL, Python, Streamlit, Tableau, AWS, Microsoft Azure, Google Cloud Platform (GCP), MLOps, LLMOps, Microsoft Excel, Microsoft PowerPoint, SAS, Emblem
5d
Save
Mark Applied
Hide
Executive Director of Applied AI
Cambridge or East Hanover
$225k-$419k/yr HybridFull Time
Novartis
NovartisNew York Stock Exchange: NVS: Develops and manufactures innovative prescription medicines for patients.
15+ YOEBachelor's degree and 15+ years of progressive technology leadership or enterprise AI experience. Requires hands-on applied AI delivery, software engineering, Python, cloud platforms, and leadership of technical teams.
Python, AWS, MLOps, LLMOps, APIs
1d
Save
Mark Applied
Hide
Senior Analyst, Advanced Analytics: Auto Physical Damage (APD)
United States or Columbus or Seattle or Boston or Houston or Plano or Portsmouth
$83k-$157k/yr HybridFull Time
Liberty Mutual
Liberty Mutual: Provides diversified property, casualty, and commercial insurance products.
3+ YOEBachelor's degree in a quantitative field or equivalent experience, 3+ years in analytics, data science, ML engineering, or related work, plus SQL, Python, machine learning, dashboarding, and communication skills.
Streamlit, Tableau, SQL, Python, Microsoft Excel, Microsoft PowerPoint, SAS, Emblem, AWS, Azure, GCP, CI/CD, MLOps, LLMOps, RAG
5d
Save
Mark Applied
Hide
Executive Director of Applied AI
Cambridge, Massachusetts, United States
$225k-$419k/yr OnsiteFull Time
Novartis
NovartisSIX Swiss Exchange, NYSE: NOVN, NVS: A global healthcare developing medicines and innovative health solutions.
15+ YOEBachelor's degree and 15+ years in technology leadership, enterprise AI transformation, or complex solution delivery. Requires hands-on applied AI, software engineering, Python, cloud, orchestration, vector databases, and team leadership.
Python, AWS, MLOps, LLMOps
23h
Save
Mark Applied
Hide
AI Solution Architect_Boston
Boston, Massachusetts, United States
$64k-$224k/yr OnsiteFull Time, Contract
Photon: An organization developing enterprise artificial intelligence platforms and software solutions.
10+ YOERequires 10–15+ years of software engineering experience, including 4+ years in AI/ML architecture, with expertise in agentic AI, RAG, Python, cloud AI, vector search, APIs, event-driven systems, and microservices.
Python, LangChain, LangGraph, AutoGen, CrewAI, LlamaIndex, Azure OpenAI, AWS Bedrock, Google Vertex AI, Pinecone, Qdrant, OpenSearch, pgvector, Kafka, RabbitMQ, Docker, Kubernetes, Terraform, Redis, Salesforce, Microsoft SharePoint, Confluence, SQL, NoSQL, Ragas, TruLens, DeepEval, CI/CD, IAM, RBAC, RAG, LLMOps