64 program manager ai llm programs jobs at 48 companies in New York

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
1w
Save
Mark Applied
Hide
Senior AI Program Manager, Talent
United States or California or Connecticut or Maryland or Massachusetts or New Jersey or New York or Washington or District of Columbia or Colorado or Hawaii or Illinois or Maine or Minnesota or Nevada or Ohio or Rhode Island or Vermont or Virginia
$104k-$174k/yr RemoteFull Time
Zillow Group
Zillow GroupNasdaq: ZG: Operates a digital marketplace for buying, selling, and renting homes.
5+ YOE5–8 years in product, applied AI, or HR tech; hands-on experience with LLM APIs and building AI prototypes; working knowledge of Talent processes; strong communication and data literacy.
LLM APIs, LangChain, CrewAI, Workday, Eightfold
4w
Save
Mark Applied
Hide
XPG Technical Program Manager - Vice President
New York, New York, United States
$150k-$215k/yr OnsiteFull Time
Morgan Stanley
Morgan StanleyNYSE: MS: Global financial services firm providing investment and wealth management.
8+ YOE8+ years program/project management experience in financial services or technology; strong Agile experience; technical skills in Python, automation, data modeling and reporting (Power BI); familiarity with Generative AI/LLMs; stakeholder management and mentoring.
Python, Microsoft Power BI, LLM, Generative AI, co-pilot, Agile
1mo
Save
Mark Applied
Hide
AI Operations Manager
Denver or New York City or Leeds or Dublin
$100k-$135k/yr HybridFull Time
Fanatics
Fanatics: Global digital sports platform for merchandise, collectibles, and betting.
3+ YOE3+ years in AI operations or related data-heavy technical role; hands-on understanding of LLMs, prompt engineering, RAG, SQL and analytics; experience operating AI in production; people management and strong stakeholder communication.
LLMs, Retrieval-Augmented Generation (RAG), SQL, Snowflake, BigQuery, Python, CRM
4w
Save
Mark Applied
Hide
XPG Technical Program Manager - Vice President
New York or Montreal
$150k-$215k/yr OnsiteFull Time
Morgan Stanley
Morgan StanleyNYSE: MS: Provides global investment banking, wealth management, and advisory services.
8+ YOE8+ years program/project management experience in financial services or technology, Agile experience, hands-on Python, automation, data modeling, Microsoft Power BI, Generative AI familiarity, strong stakeholder and change management, mentoring experience.
Python, Microsoft Power BI, Generative AI, LLM
1mo
Save
Mark Applied
Hide
Manager, AI Strategy
New York, New York, United States
OnsiteFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
Manage and coordinate data and engineering workstreams; strong project coordination, knowledge of data sourcing/governance, tracking/reporting tools, stakeholder communication, and experience operationalizing AI technologies.
LLM
1mo
Save
Mark Applied
Hide
AI Transformation Consultant - AVP
United States or Washington or New York City
$160k-$180k/yr RemoteFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
12+ YOE12+ years in technology consulting or enterprise AI program leadership; hands-on AI/ML, RPA (UiPath, Automation Anywhere), IDP, GenAI; program leadership, Agile/Waterfall experience, CXO stakeholder communication; MBA preferred.
UiPath, Automation Anywhere, RPA, AI/ML, IDP, GenAI, LLM, Task Mining, Workforce Intelligence, Agile, Waterfall
3w
Save
Mark Applied
Hide
AI Delivery Lead
San Francisco or New York City or Seattle or Charlotte or Los Angeles or Houston or Atlanta or Baltimore or Chicago or Washington D.C.
$143k-$170k/yr HybridFull Time
Sia
Sia: Provide management and AI consulting for business transformation.
7+ YOE7+ years program/project experience and 3–5 years technical/AI delivery; hands-on experience with AI agents/LLMs and automation; Agile delivery, stakeholder management, program governance; Bachelor’s required; must be eligible to work in the U.S.
OpenAI, Claude, Microsoft Copilot, Gemini, LLMs, ServiceNow, Smartsheet, Microsoft Project, Azure DevOps, Tableau
2w
Save
Mark Applied
Hide
Project Manager, AI Initiatives
New York, New York, United States
$150k-$200k/yr OnsiteFull Time
Rockefeller Capital Management
Rockefeller Capital Management: Provides wealth management and financial advisory services to clients.
7+ YOEBachelor's degree required, 7+ years in technology program/product/project management (financial services preferred); hands-on experience with enterprise AI programs, AI/ML concepts, LLMs, and governance; proficiency with Copilot and Claude toolsets and Microsoft Office.
Copilot Chat, Copilot Studio, Copilot Research, Cowork, Claude Skills, Claude Projects, Microsoft Excel, Microsoft PowerPoint
2d
Save
Mark Applied
Hide
AI Solutions Deployment Manager, Cloud Applied AI
Waterloo or New York City or Sunnyvale
$183k-$266k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
8+ YOEBachelor's in STEM or equivalent,8 years customer-facing technical experience,3 years coding (Python/Java),experience with LLMs and conversational AI,ability to lead cross-functional technical deployments.
Python, Java, Large Language Models (LLMs), Google Cloud Platform (GCP), Gemini Enterprise
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)
New York City or McLean or Cambridge or San Jose
$251k-$286k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's in CS/AI/EE/CE +6 yrs or Master's +4 yrs; 6+ years programming with Python, Go, Scala, or Java; experience building and deploying large-scale AI/LLM systems, cloud platforms, and mentoring teams.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure
4w
Save
Mark Applied
Hide
AI Operations Lead
Berlin or Iași or London or New York City or São Paulo or United States or Germany or United Kingdom or Romania
HybridFull Time
Taktile
Taktile: Platform for automated financial risk and credit decisioning.
5+ YOE5+ years in consulting/operations or similar; production-grade Python and SQL; hands-on LLM/agent tooling experience; strong program management, technical deployment, and cross-functional communication; fluent English.
Claude, Python, SQL, AWS, Snowflake, dbt, Terraform, Notion, Linear, HubSpot, Gong, Ramp, MCP
3w
Save
Mark Applied
Hide
Director, Enterprise AI Operations
California or Colorado or Connecticut or District of Columbia or Florida or Georgia or Maine or Maryland or Massachusetts or New Jersey or New York or North Carolina or Pennsylvania or South Carolina or Tennessee or Texas or Washington
$180k-$195k/yr RemoteFull Time
Forbes
Forbes: Global media providing business news and financial journalism.
8+ YOE8+ years leading transformation or operations programs; experience operationalizing AI/LLMs, change management, building enablement and governance, cross-functional partnership with Product/Legal/HR, and measuring adoption and impact.
OpenAI, Vertex AI
5h
Save
Mark Applied
Hide
AI in Operations Strategy and Transformation Office - Senior Associate
New York or Boston
$138k-$145k/yr OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years strategy or consulting experience, strong analytical and communication skills, familiarity with AI/LLM/ML/RPA, Bachelor's degree in quantitative field, experience leading program offices.
AI/LLM, ML, RPA
3mo
Save
Mark Applied
Hide
Forward Deployed Banker (AI Strategist)
New York City, New York, United States
$90k-$160k/yr OnsiteFull Time
Hebbia
Hebbia: AI-powered research platform for financial institutions and professionals.
1+ YOEBachelor’s in Finance, Economics, Computer Engineering, or Pre-Law; 1-5 years client-facing experience in IB, institutional investing, corporate law, corporate finance, or consulting; strong ownership and experience with LLMs.
LLM, AI tools
2w
Save
Mark Applied
Hide
AI Strategy and Delivery Lead
New York, New York, United States
$120k-$160k/yr HybridFull Time
Bridge Atlantic
Bridge Atlantic: Consultancy specializing in digital transformation and SAP implementations.
Experience deploying enterprise AI, stakeholder alignment, governance and risk management, agile delivery, metrics-driven adoption, and familiarity with LLMs and generative AI.
LLMs
1mo
Save
Mark Applied
Hide
Director, AI Solution Delivery
New York City, New York, United States
$134k-$248k/yr HybridFull Time
Nasdaq
NasdaqNASDAQ: NDAQ: Operates global electronic marketplaces and provides financial technology services.
10+ YOEExtensive AI delivery leadership in finance/fintech; strong Python, AWS, Terraform; Generative AI, LLMs, RAG; executive communication; proven delivery of AI solutions.
Python, AWS, Terraform, Visual Studio Code, Git, RPA (Automation Anywhere, Blue Prism), LLMs, Retrieval-Augmented Generation, Web scraping
1w
Save
Mark Applied
Hide
AI Solutions Architect
Eagan or Frisco or New York or Ann Arbor
$100k-$186k/yr RemoteFull Time
Thomson Reuters
Thomson ReutersNASDAQ: TRI: Provides professional software, data, and news services globally.
2+ YOEJuris Doctor preferred; 2+ years law firm or legal department experience; expertise in transactional practice; experience with generative AI/LLMs; strong communication and documentation skills.
Microsoft Excel, Microsoft PowerPoint, Large language model (LLM)
1mo
Save
Mark Applied
Hide
Head of AI & Program Technology Engineering
New York City or Nairobi or London
$185k-$200k/yr HybridFull Time
International Rescue Committee
International Rescue Committee: Provides humanitarian aid and relief to people affected by conflict.
7+ YOE3+ MgmtSenior technical leader with 7+ years in software engineering (3+ years managing engineers), hands-on production AI experience (LLMs, RAG, agentic systems), strong full-stack skills (Python, JavaScript/TypeScript), cloud architecture (Azure preferred), DevOps and security experience.
Python, JavaScript, TypeScript, Microsoft Azure, AWS, GCP, LLM, RAG, CI/CD, DevOps, infrastructure-as-code, OpenAI, Anthropic, Signpost, computer vision
4w
Save
Mark Applied
Hide
AI Builder, Emerging Talent Manager
San Francisco or Chicago or New York City or Denver or Atlanta or Boston or Seattle or Washington or United States
$155k-$263k/yr HybridFull Time
Salesforce
SalesforceNYSE: CRM: Sells cloud-based customer relationship management and business software solutions.
5+ YOE1+ MgmtBachelor's in computer science or software engineering required. 5+ years in technical consulting/solution architecture/software engineering, 1+ year managing technical teams. Proficiency in Python, JavaScript/TypeScript, or Java; experience with React, REST APIs, GraphQL, Git, Apex, LLMs, and generative AI concepts. Strong people leadership and cu...
Python, JavaScript, TypeScript, Java, React, REST APIs, GraphQL, Git, Apex, Agentforce, LLMs
1mo
Save
Mark Applied
Hide
ServiceNow -ServiceNow AI Architect Senior Manager - Tech Cons - Open Location
Chicago or New York City or Washington or California or United States
$172k-$392k/yr HybridFull Time
EY
EY: Global firm providing audit, tax, and professional consulting services.
5+ YOEBachelor's degree required, 5+ years ServiceNow/platform implementation experience, ServiceNow suite certification (NOW Assist for ITSM/HRSD/CSM) required, 2-5 years NOW Assist experience preferred, expertise in multi-LLM, RAG, Moveworks, AI Control Tower, data pipelines, and leading teams.
ServiceNow, NOW Assist, Moveworks, AI Control Tower, large language models, Retrieval-Augmented Generation (RAG), MCP servers, Agent-to-Agent protocols