42 program manager ai llm programs jobs at 20 companies in Gilroy, CA

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
2mo
Save
Mark Applied
Hide
Senior Technical Program Manager. AI Security
San Jose, California, United States
$158k-$236k/yr HybridFull Time
F5
F5NASDAQ: FFIV: Provides application delivery networking and multi-cloud security solutions.
8+ YOE8+ years of technical program management in security/AI, with distributed teams; strong knowledge of AI/ML and LLM-based tools; excellent communication and stakeholder management.
AI/ML, LLM, Security tools
2mo
Save
Mark Applied
Hide
Cloud AI Technical Program Manager III
Sunnyvale or Kirkland
$163k-$237k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
5+ YOEBachelor's degree or equivalent; 5 years program management; AI model training/LLM release experience; AI product KPIs.
2w
Save
Mark Applied
Hide
Senior Technical Program Manager - AI Acceleration
Santa Clara, California, United States
$168k-$322k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
10+ YOEBachelor's or equivalent in CS/EE, 10+ years TPM experience in AI and ASIC/chip design, strong RTL/simulation/formal verification knowledge, experience with LLM/AI systems, program leadership and stakeholder communication.
LLM, RTL
2w
Save
Mark Applied
Hide
Senior Technical Program Manager - AI Acceleration
Santa Clara, California, United States
$168k-$322k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
10+ YOEBachelor's in CS/EE or equivalent experience, 10+ years technical program management in AI and ASIC/chip design, strong RTL/simulation/formal verification knowledge, hands-on experience with LLM/AI agent integrations, excellent communication and leadership.
3w
Save
Mark Applied
Hide
Insights Program Manager - AI Infrastructure
San Francisco or Sunnyvale or New York City or Chicago
$105k-$170k/yr HybridFull Time
LinkedInNASDAQ: MSFT: Professional social network for career development and job recruitment.
3+ YOEBA in a quantitative/technical field; 3+ years in data analysis, experimentation, or technical program management; 3+ years SQL (Trino/Spark SQL preferred); 2+ years Python; experience with data pipelines, Airflow, HDFS, Tableau, GitHub, and GenAI/LLM concepts preferred.
SQL, Trino, Spark SQL, Python, Apache Airflow, HDFS, Tableau, GitHub, Large Language Models (LLM), Retrieval Augmented Generation (RAG)
1w
Save
Mark Applied
Hide
Sr. Technical Program Manager, Alexa Calendar
Sunnyvale, California, United States
OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
7+ YOE7+ years working with engineering teams, 5+ years technical program/product management, 3+ years software development; experience with large-scale consumer AI products, cross-team program delivery, KPI/SLA definition, and stakeholder communication.
React Native, LLM, Large language models
2d
Save
Mark Applied
Hide
Technical Program Manager - Digital Operations
Fremont, California, United States
OnsiteFull Time
AMAX
AMAXTaiwan Stock Exchange: 6933: Designs and manufactures GPU-accelerated AI and HPC computing infrastructure.
3+ YOE3+ years in TPM/industrial/process/manufacturing roles, bilingual Mandarin and English, hands-on MES/ERP exposure, knowledge of AI agents/LLMs, SQL, and API integrations.
MES, ERP, AI agents/LLMs, SQL, API
3mo
Save
Mark Applied
Hide
Operations Program Manager, iPhone
Cupertino or Sunnyvale
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
5+ YOE5+ years in manufacturing, process engineering or product development; bachelor's in engineering; travel 20-25%.
AI/ML, Machine Learning, LLM, Robotic Process Automation, Quantum Computing
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)
New York City or McLean or Cambridge or San Jose
$251k-$286k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's in CS/AI/EE/CE +6 yrs or Master's +4 yrs; 6+ years programming with Python, Go, Scala, or Java; experience building and deploying large-scale AI/LLM systems, cloud platforms, and mentoring teams.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure
1mo
Save
Mark Applied
Hide
Staff Technical Program Manager, Managed Intelligence
San Francisco or Sunnyvale
$193k-$234k/yr OnsiteFull Time
Crusoe
Crusoe: Provides energy-efficient cloud infrastructure powered by stranded and renewable energy.
7+ YOE7+ years TPM in fast-paced tech; LLM inference knowledge; multi-tenant systems; model onboarding; executive comms; AI tooling; cross-functional influence.
LLM inference, CUDA, ROCm, GPU hardware, IaaS, model serving
1w
Save
Mark Applied
Hide
Global Lead, AI Content Red Team - Trust and Safety
San Jose, California, United States
$159k-$384k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
5+ YOE5+ Mgmt5+ years in trust & safety or adversarial testing with 5+ years leading teams; expertise in generative AI red‑teaming, LLM failure modes, and influencing product and policy decisions.
3w
Save
Mark Applied
Hide
Operations Project Manager|Services
Milpitas or Ann Arbor
$167k-$285k/yr OnsiteFull Time
KLA
KLANASDAQ: KLAC: Provides process control and yield management for semiconductor manufacturing.
3+ YOEDevelop and lead service programs, coordinate cross-functional projects, drive process improvements and change management; 3–5+ years experience (5 yrs with BS or 3 yrs with MS) and willingness to travel up to 25%.
AI, LLM, CRM, SAP, ECO management, DMAIC, Six Sigma
1mo
Save
Mark Applied
Hide
Principal Product Manager
United States or San Francisco or Mountain View or Redmond
$143k-$331k/yr RemoteFull Time
Microsoft
MicrosoftNASDAQ: MSFT: Develops software, services, devices, and cloud computing solutions.
8+ YOEBachelor's degree and 8+ years in product/service/program management or software development (or equivalent experience). Experience leading large-scale, cross-functional products, working with AI/ML/LLM, strong customer insight, and ability to pass Microsoft Cloud background check.
LLM, A/B testing
2w
Save
Mark Applied
Hide
Senior Product Manager – ROCm & AI/ML Inference Software
Santa Clara or Austin or United States
$180k-$309k/yr HybridFull Time
AMD
AMDNASDAQ: AMD: Designs and manufactures computer processors and graphics technology.
Experienced product leader with deep GPU computing and open-source software knowledge; familiarity with PyTorch/JAX/Triton, LLM inference techniques, GPU programming (HIP/CUDA/Triton), and open-source community engagement; Bachelor’s in CS/EE or equivalent experience.
PyTorch, JAX, Triton, vLLM, SGLang, HIP, CUDA, GitHub
1mo
Save
Mark Applied
Hide
Commerce Architecture & Delivery Senior Manager I Agentic Commerce
Chicago or Milwaukee or Herndon or Dallas or Columbus or Kirkland or Irvine or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Albany or Arlington or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or San Francisco or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$113k-$302k/yr OnsiteFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
12+ YOE12+ years delivering enterprise commerce and digital platforms, leadership experience, strong expertise with Salesforce/Adobe/SAP/composable (MACH), agentic AI/LLMs/RAG/vector DBs, API/microservices architectures, CI/CD and cloud-native deployments.
Salesforce, Salesforce Commerce, Adobe, Adobe Commerce, SAP, SAP Commerce, MACH, LLMs, RAG, vector databases, CI/CD, Kubernetes, Azure, AWS, GCP, CRM, CDP
1mo
Save
Mark Applied
Hide
Head of Materials AI (San Jose, California, US, 95134)
San Jose or Germany or Taiwan or Korea or Japan
$227k-$341k/yr OnsiteFull Time
Merck
MerckXETRA: MRK: A science and technology providing healthcare, life science, and electronics solutions.
10+ MgmtAdvanced degree (PhD or equivalent) or experience; 10+ years leading technical teams and large-scale digital/AI transformation programs; hands-on AI/ML deployment experience (LLMs, Bayesian optimization, MLIP); experience delivering digital products in R&D settings and leading international teams.
ELN, LLMs, Bayesian optimization, ML interatomic potential (MLIP)
2mo
Save
Mark Applied
Hide
Technical Leader, Software Engineer (AI Canvas)
Milpitas, California, United States
$184k-$264k/yr HybridFull Time
Cisco
CiscoNASDAQ: CSCO: Develops and sells networking hardware and cybersecurity software.
10+ YOE10+ years backend software engineering, Python, asynchronous programming; experience with large-scale distributed systems, AI/LLM apps, Kubernetes, CI/CD, observability; strong leadership and mentoring.
Python, Kubernetes, Temporal, Airflow, Azure OpenAI, AWS Bedrock, CI/CD, Observability tools, LLM platforms
1d
Save
Mark Applied
Hide
Operations Enablement Analyst, Data Center Operations
Bellevue or Livingston or New York or Sunnyvale or San Francisco or United States
$109k-$145k/yr OnsiteFull Time
CoreWeave
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
3+ YOE3+ years documenting technical operations in data center or infrastructure environments; experience with SOPs, runbooks, version control, and compliance-focused documentation; strong writing and analytical skills.
AI, LLM
1w
Save
Mark Applied
Hide
Research Scientist - Technologies of Data Management, LLM and AI Agents - Global Frontier Tech Recruitment Program - 2027 Start (PhD)
San Jose, California, United States
OnsiteFull Time
ByteDance
ByteDance: Developing AI-driven content platforms and mobile applications.
PhD (completed or completing) in CS or related field; strong coding in C/C++, Python or Go; data-structures and algorithms; ability to design and develop complex systems; familiarity with data management technologies.
C/C++, Python, Go
1w
Save
Mark Applied
Hide
Risk Data Analyst
San Jose or Draper or United States
$96k-$135k/yr RemoteFull Time
BILL
BILLNYSE: BILL: Automated financial operations software for small and midsize businesses.
2+ YOE2+ years in risk, portfolio analytics, or program management; vendor management and ROI tracking; SQL/Python/R; Tableau or AWS QuickSight; experience with AI/automation tools; project ownership and cross-functional communication.
Tableau, AWS QuickSight, Claude, Gemini, GitHub Copilot, GitLab Duo, SQL, Python, R, LLM