18 program manager ai llm programs jobs at 13 companies in Needham, MA
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Columbia Construction: Provides construction management and general contracting services in the Northeast.
Proven success leading AI or technology initiatives, familiarity with LLMs and enterprise AI tools, data governance understanding, change leadership, excellent communication, and ability to build prototypes and governance.
Program Manager - Intelligence/National Security Program
Reston or Boston or Cleveland or Australia or Canada or Israel or Japan or United Kingdom
$170k-$220k/yrHybridFull Time
Babel Street: AI-powered identity intelligence and risk operations software solutions.
5+ YOE5+ years program management delivering software to IC/DoD, active TS/SCI with Polygraph required, U.S. citizenship required, expertise in Generative AI/LLM APIs/agentic frameworks and cloud-native (AWS/C2E), experience with ATO/ICD 503/NIST 800-53B.
Model Context Protocol (MCP), Agentskills, LLM APIs, AWS, C2E
WHOOP: Wearable technology for personalized health and performance tracking.
4+ YOE4+ years technical program management supporting AI/ML or algorithm teams; deep understanding of ML lifecycle, experience with AI tools/LLMs, agile/sprint planning, strong communication and cross-functional coordination.
Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)
New York City or McLean or Cambridge or San Jose
$251k-$286k/yrOnsiteFull Time
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's in CS/AI/EE/CE +6 yrs or Master's +4 yrs; 6+ years programming with Python, Go, Scala, or Java; experience building and deploying large-scale AI/LLM systems, cloud platforms, and mentoring teams.
ManulifeTSX: MFC: Provides insurance, wealth management, and investment services globally.
8+ YOE8+ years in data science/AI/ML engineering with delivery experience; hands-on Python, cloud ML, MLOps, vector DBs, LLM-Ops; experience in financial crime prevention and partnering with Risk/Legal/Procurement; people leadership; bachelor’s required, advanced degree preferred.
Python, cloud ML environments, MLOps, vector databases, LLM-Ops, Agentic AI
Senior Lead AI Engineer (FM Hosting, LLM Inference)
New York or McLean or Cambridge or San Jose
$251k-$286k/yrOnsiteFull Time
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
6+ YOEBachelor's in CS/AI/EE/CE or related with 6+ years (or Master's with 4+ years); 6+ years programming with Python, Go, Scala, or Java; experience deploying scalable AI systems, LLM inference, similarity search, and optimization of training/inference.
San Francisco or Chicago or New York City or Denver or Atlanta or Boston or Seattle or Washington or United States
$155k-$263k/yrHybridFull Time
SalesforceNYSE: CRM: Sells cloud-based customer relationship management and business software solutions.
5+ YOE1+ MgmtBachelor's in computer science or software engineering required. 5+ years in technical consulting/solution architecture/software engineering, 1+ year managing technical teams. Proficiency in Python, JavaScript/TypeScript, or Java; experience with React, REST APIs, GraphQL, Git, Apex, LLMs, and generative AI concepts. Strong people leadership and cu...
Posit: Develops open-source and professional software for data science.
Extensive experience managing post-sales technical teams in B2B enterprise software; strong operational mindset, experience with SOW scoping and delivery, AI/LLM tool fluency, and ability to hire/coach and build repeatable delivery processes.
AI Enablement and Adoption Lead, Strategy and Operations, Specialty Care GBU
Cambridge or Morristown
$161k-$233k/yrHybridFull Time
SanofiEuronext Paris: SAN: Researches, develops, and manufactures medicines and vaccines globally.
5+ YOEBachelor's degree required; 5+ years experience driving AI tool adoption and changing ways of working with senior leaders; practical fluency with LLM-based tools; strong influence, communication, and compliance judgment.
Senior Lead AI Engineer(MLX, Agentic AI, Gen AI platform Services)
San Francisco or McLean or Cambridge or San Jose or New York City
$251k-$286k/yrOnsiteFull Time
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
6+ YOEBachelor's in CS/AI/EE/CE (or related) with 6+ years (or Master's with 4+ years). 6+ years programming in Python, Go, Scala, or Java. Experience building and deploying scalable AI/ML systems, LLM inference, vector search, guardrails, and cloud platforms.
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's (plus 6 years) or Master's (plus 4 years) in CS/AI/EE/CE or related; 4–6+ years developing AI/ML systems; 6+ years programming with Python/Go/Scala/Java; experience with LLMs, inference, vector DBs, guardrails, cloud deployments; strong communication.
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York or San Francisco or McLean or Cambridge or San Jose or Plano
$209k-$286k/yrOnsiteFull Time
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's in CS/AI/EE/CE +6 years or Master's +4 years; 6+ years programming with Python/Go/Scala/Java; experience deploying scalable AI on cloud; LLM, inference, similarity search, VectorDBs, guardrails, model evaluation, and optimization experience; leadership and research literacy.
Commerce Architecture & Delivery Senior Manager I Agentic Commerce
Chicago or Milwaukee or Herndon or Dallas or Columbus or Kirkland or Irvine or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Albany or Arlington or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or San Francisco or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$113k-$302k/yrOnsiteFull Time
AccentureNYSE: ACN: Global provider of management consulting and technology services.
12+ YOE12+ years delivering enterprise commerce and digital platforms, leadership experience, strong expertise with Salesforce/Adobe/SAP/composable (MACH), agentic AI/LLMs/RAG/vector DBs, API/microservices architectures, CI/CD and cloud-native deployments.
Content Automation and GenAI - Consulting and Delivery Manager
New York City or Milwaukee or Herndon or Dallas or Columbus or Kirkland or Irvine or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or Arlington or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or San Francisco or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$266k/yrOnsiteFull Time
AccentureNYSE: ACN: Global provider of management consulting and technology services.
7+ YOE7+ years client-facing consulting or digital transformation experience; hands-on experience evaluating/applying content automation or GenAI tools and delivering GenAI POCs; strong understanding of LLM concepts, prompt engineering, safety/responsible AI, content operations, and team leadership.
Atlanta or New York or Boston or Miami or Charlotte or Washington or Philadelphia
$157k-$237k/yrOnsiteFull Time
Slalom: Provides business and technology consulting and software engineering services.
7+ YOE7+ years client-facing technical or advisory experience; experience designing and delivering LLM/AI solutions; proven revenue responsibility; hands-on experience with Claude, OpenAI GPT or equivalent; strong communication and advisory skills.
Claude, Claude Enterprise, Claude Code, Cowork, Claude API, OpenAI GPT, MCP (Model Context Protocol)
CVS HealthNYSE: CVS: Provides retail pharmacy, health insurance, and pharmacy benefit management services.
3+ YOE3+ years analytic experience; programming in R or Python; experience with SQL; strong algorithm and predictive modeling knowledge; experience with LLMs/Generative AI preferred; bachelor’s degree or equivalent.