HiringCafe
Join our community

28 llmops engineer jobs at 20 companies in San Mateo, CA

1mo
Save
Mark Applied
Hide
Staff AI Engineer
Miami or New York or San Francisco or Mexico City or United States
RemoteFull Time
Félix Pago
Félix Pago: Remittance platform for money transfers via WhatsApp messaging.
8+ YOE8+ years software engineering experience with infrastructure and systems development; 2+ years building production LLM/AI applications; strong Python, system architecture, containerization (Docker/Kubernetes), CI/CD, observability, RAG and agentic systems experience.
Python, Docker, Kubernetes, CI/CD, LLM APIs, LLMOps, RAG, vector databases, Open CLAW, Hermes, WhatsApp
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior. Distinguished AI Engineer (Agentic AI Platform)
San Francisco or McLean or Cambridge or San Jose or New York
$343k-$392k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
8+ YOEMaster's + 8 years or Bachelor's + 10 years in AI/ML; deep software engineering skills; experience with agentic frameworks, LLMOps, cloud platforms, Kubernetes, and mentoring/architecting large-scale AI systems.
Python, Go, Golang, Scala, Java, C++, C#, LangGraph, AutoGen, Semantic Kernel (Microsoft), Semantic Kernel, LangChain, CrewAI, LlamaIndex, LLMOps, Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning, AWS, Google Cloud, Azure, K8s, Helm, CRDs, CLI, SDK, VectorDBs
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Agentic AI Engineer
Bulgaria or Belmont
OnsiteFull Time
RingCentral
RingCentralNYSE: RNG: Sells cloud-based business phone and video conferencing software.
5+ YOEBS/MS in CS/AI or related, 5+ years software engineering experience with 1+ years building/deploying generative AI/LLM applications, strong Python, RAG, vector/graph DBs, AWS, agentic frameworks, LLMOps, and excellent communication.
Python, Retrieval-Augmented Generation (RAG), Model Context Protocol (MCP), AWS, LLMOps, vector databases, graph databases
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior AI Platform Engineer - Frisco
Frisco or San Jose
$107k-$176k/yr HybridFull Time
McAfee
McAfee: Provides cybersecurity and privacy protection software for consumers.
10+ YOE10+ years platform engineering experience with GenAI/LLM ecosystems, Kubernetes (EKS/GKE), cloud (AWS/GCP), Python and Go, Terraform, Backstage, CI/CD, vector stores/OpenSearch, Kafka, and enterprise AI security and governance.
AWS Bedrock, OpenAI, Anthropic, Kubernetes, GKE, EKS, Python, Go, FastAPI, gRPC, AWS, GCP, Terraform, Backstage, OpenSearch, Aurora pgvector, CI/CD, Apache Kafka, LangChain, LlamaIndex, Pinecone, Weaviate, IAM, VPC, KMS, MLOps, LLMOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior. Distinguished AI Engineer - Agentic AI Platform (Remote Eligible)
San Francisco or McLean or New York City or San Jose or United States or Cambridge
$286k-$392k/yr RemoteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
10+ YOEBachelor's degree plus 10 years or master's plus 8 years developing AI/ML technologies; 10 years programming; experience with scalable AI platforms, agentic frameworks, LLMOps, Kubernetes, and technical leadership.
Python, Go, Scala, Java, AWS, Google Cloud, Azure, LangGraph, AutoGen, Semantic Kernel, CrewAI, LlamaIndex, Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning, C++, C#, Golang, Helm, Kubernetes, CRDs, LLM Inference, VectorDBs, K8s
Job PostingView all
1w
Save
Mark Applied
Hide
Senior AI Engineer - Services Special Projects
San Francisco, California, United States
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
Experienced ML engineer to build, deploy, optimize and operationalize LLM-based applications with strong MLOps/LLMOps and scalable production systems expertise.
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Developer Relations Manager – AgentOps
Santa Clara, California, United States
$224k-$431k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
12+ YOE12+ years experience; BS/MS/PhD in CS/Engineering; leadership; expertise in AgentOps, GenAIOps, LLMOps, generative/agentic AI; strong communication and collaboration.
CUDA, CUDA-x libraries, Nemotron, NIM, NeMo, Agent Toolkits, Blueprints
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer II – AI Engineer (w/ skills in Deployment)
San Ramon, California, United States
$85k-$124k/yr RemoteFull Time
Robert Half
Robert HalfNYSE: RHI: Provides specialized staffing and global business consulting services.
4+ YOE4+ years IT experience with 2+ years software engineering and 1+ year GenAI deployment; experience with LLMs, RAG, prompt engineering, CI/CD, containers, cloud platforms, and observability.
Python, Java, C#, JavaScript, SQL, LangChain, Semantic Kernel, AutoGen, CI/CD, Azure, AWS, GCP, LLMOps, MLOps
Job PostingView all
4w
Save
Mark Applied
Hide
AI Engineer
Santa Clara, California, United States
$64k-$115k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
5+ YOE5+ years AI/ML experience, 1+ year building agentic AI, strong Python, LangGraph/LangChain and LLM experience, prompt engineering, cloud AI platforms, APIs, CI/CD, enterprise deployment and leadership skills.
Python, LangGraph, LangChain, LLMs, GPT, Claude, Llama, Azure AI Foundry, AWS Bedrock, Google Gemini Enterprise, APIs, CI/CD, Claude Code, Codex, Databricks, MLOps, LLMOps
Job PostingView all
3w
Save
Mark Applied
Hide
AI Engineer
Santa Clara, California, United States
$94k-$141k/yr OnsiteFull Time
UST
UST: Global provider of digital transformation and IT services.
3+ YOERequires 3–5 years in ML or AI, 1+ year building agentic AI applications, strong Python, LLM and prompt engineering experience, LangGraph, cloud AI platforms, APIs, CI/CD, Git, and communication skills.
LangGraph, LangChain, GPT, Claude, LLaMA, Jenkins, Git, Jira, Confluence, Claude Code, Codex, Azure AI Foundry, AWS Bedrock, Google Gemini Enterprise, Databricks, REST APIs, WebSockets, Python, MLOps, LLMOps, AI Governance
Job PostingView all
2d
Save
Mark Applied
Hide
AI Engineering & Platform Leadership Senior Manager - Utilities
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$113k-$338k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
10+ YOE5+ MgmtRequires 10+ years in software or AI/ML engineering, 6+ years architecting enterprise AI platforms, leadership experience, multi-cloud and LLMOps expertise, utilities experience, and a bachelor's degree or equivalent.
OpenAI, Anthropic, AWS, Azure, Google, LLMOps, MLOps, FinOps
Job PostingView all
2mo
Save
Mark Applied
Hide
Engagement Tech Lead, Developer Relations - AI Agents
Santa Clara, California, United States
$224k-$431k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
12+ YOEBS/MS/PhD in CS/Engineering or equivalent, 12+ years experience, expertise in AgentOps/GenAIOps/LLMOps/generative and agentic AI, strong leadership, communication, and ecosystem development skills.
NVIDIA Cuda-x libraries, Nemotron, NIM, NeMo libraries, Agent Toolkits, Blueprints, NVIDIA GPUs, SDKs
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Software Engineer
San Francisco, California, United States
OnsiteFull Time
Workato
Workato: Enterprise platform for automating business workflows and integrating applications.
5+ YOE5+ years professional software development; Bachelor’s or Master’s in CS/Engineering/Information Systems or equivalent experience; proficient in Go, Python, Ruby, or JavaScript; experience with LLMs and deploying ML services.
Go, Python, Ruby, JavaScript, LLM, LLMops, MLops
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Engineer, Marketing Technology
San Francisco, California, United States
$155k-$170k/yr HybridFull Time
Sephora
SephoraEuronext Paris: MC: Retailer of beauty products including cosmetics, skincare, and fragrance.
7+ YOE7+ years building large-scale data warehouse and full-stack engineering solutions; experience with ETL, cloud (GCP/Azure), ML, AI-augmented engineering, Python/R/SQL, and strong communication and problem-solving skills.
GitHub Copilot, Claude/Claude Code, Informatica, Pentaho, Data Stage, Python, R, SQL, Scala, Shell, Perl, GCP, GMP, Azure, Agentic AI Tools, AI-SDLC, open-source LLMs, LLMOPS, Machine Learning as a Service (MLAAS)
Job PostingView all
4w
Save
Mark Applied
Hide
Senior. Distinguished AI Engineer - Agentic AI Platform (Remote Eligible)
San Francisco or McLean or New York City or San Jose or Cambridge or United States
$286k-$392k/yr RemoteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
10+ YOEBachelor's degree plus 10 years or master's degree plus 8 years in AI/ML, and 10 years programming with Python, Go, Scala, or Java; cloud AI, agentic frameworks, LLMOps, and ML platform experience preferred.
Python, Go, Scala, Java, AWS, Google Cloud, Azure, LangChain, CrewAI, Semantic Kernel, Microsoft, AutoGen, Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning, C++, C#, Golang, Helm, K8s, LlamaIndex, LangGraph, LlamaIndex
Job PostingView all
1mo
Save
Mark Applied
Hide
AI Principal Engineer - Clinical Data Analytics
Alameda, California, United States
$172k-$245k/yr OnsiteFull Time
Exelixis
ExelixisNASDAQ: EXEL: Discovers and commercializes innovative medicines for cancer treatment.
9+ YOEAdvanced experience in Databricks/Unity Catalog/Delta Lake, Python and SQL, data architecture and governance, MLOps/LLMOps, cloud (AWS) SaaS infra, BI tooling, and 9+ years of related experience (Master's) or 11+ (Bachelor's).
Databricks, Unity Catalog, Delta Lake, Python, SQP, R, Atlan, Colibra, Reltio, Spotfire, Tableau, Power BI, SE, EC2, Lambda, Glue, Redshift
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Software Engineer, AI Platform
Oakland, California, United States
$173k-$251k/yr HybridFull Time
Everlaw
Everlaw: Provides a cloud-based litigation platform for legal teams.
4+ YOE4+ years building distributed cloud software; 1+ year leading multi-developer efforts; strong AI/ML and retrieval systems experience.
AWS, MySQL, PostgreSQL, Vector Database, Graph Database, LLMOps, Cursor, Claude Code
Job PostingView all
3d
Save
Mark Applied
Hide
Snowflake Advanced AI Engineer,
San Francisco or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$70k-$206k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOERequires 2+ years with Snowflake Cortex AI, 3+ years deploying machine learning models, 3+ years in computer science and programming, cloud AI/ML deployment, and a bachelor's degree or equivalent experience.
Snowflake Cortex AI, Cortex Agents, Cortex Analyst, Cortex Search, Deep Learning, Generative AI, Large Language Models, DevOps, MLOps, LLMOps, Python, TensorFlow, PyTorch, C++, Java, R, SQL
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Director, AI Engineering
South San Francisco or New York City or Princeton or Chicago or Bellevue
HybridFull Time
ZS
ZS: Global management consulting and technology firm for healthcare and life sciences.
15+ YOE5+ Mgmt15+ years software engineering with 5+ years in AI/ML/data engineering, 5+ years leading multiple scrum teams, experience with multi-agent/RAG systems, LangGraph/LangChain, AWS Bedrock/SageMaker, strong eval/LLMOps and enterprise SaaS experience.
LangGraph, LangChain, AWS Bedrock, SageMaker, LangSmith, AgentCore
Job PostingView all
1mo
Save
Mark Applied
Hide
Global Client Partner
Fremont, California, United States
OnsiteFull Time
Virtusa
Virtusa: Global provider of digital engineering and IT outsourcing services.
15+ YOE15+ years in digital engineering or professional services selling complex engineering solutions to HiTech accounts; deep HiTech relationships; GenAI/LLMOps and Well-Architected knowledge; strong communication and technical fluency.
Helio (GenAI), LLMOps, CI/CD, Well-Architected Framework, microservices, serverless
Job PostingView all

Explore Jobs

Expand Your Job Search