HiringCafe
Join our community

21 llmops engineer jobs at 18 companies in Berkeley, CA

1w
Save
Mark Applied
Hide
Senior Data Engineer, GTM
Mountain View or Chicago or Irvine or New York City
$156k-$227k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
5+ YOEBachelor's degree or equivalent and 5+ years coding in Python and SQL, 5+ years MLOps/LLMOps and data pipeline design for unstructured text and ML workflows.
Python, SQL, Google Colaboratory (Colab), TensorFlow, Tensor Processing Units (TPUs)
Job PostingView all
3w
Save
Mark Applied
Hide
Senior. Distinguished AI Engineer (Agentic AI Platform)
San Francisco or McLean or Cambridge or San Jose or New York
$343k-$392k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
8+ YOEMaster's + 8 years or Bachelor's + 10 years in AI/ML; deep software engineering skills; experience with agentic frameworks, LLMOps, cloud platforms, Kubernetes, and mentoring/architecting large-scale AI systems.
Python, Go, Golang, Scala, Java, C++, C#, LangGraph, AutoGen, Semantic Kernel (Microsoft), Semantic Kernel, LangChain, CrewAI, LlamaIndex, LLMOps, Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning, AWS, Google Cloud, Azure, K8s, Helm, CRDs, CLI, SDK, VectorDBs
Job PostingView all
3w
Save
Mark Applied
Hide
Staff AI Engineer
Miami or New York or San Francisco or Mexico City or United States
RemoteFull Time
Félix Pago
Félix Pago: Remittance platform for money transfers via WhatsApp messaging.
8+ YOE8+ years software engineering experience with infrastructure and systems development; 2+ years building production LLM/AI applications; strong Python, system architecture, containerization (Docker/Kubernetes), CI/CD, observability, RAG and agentic systems experience.
Python, Docker, Kubernetes, CI/CD, LLM APIs, LLMOps, RAG, vector databases, Open CLAW, Hermes, WhatsApp
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Agentic AI Engineer
Bulgaria or Belmont
OnsiteFull Time
RingCentral
RingCentralNYSE: RNG: Sells cloud-based business phone and video conferencing software.
5+ YOEBS/MS in CS/AI or related, 5+ years software engineering experience with 1+ years building/deploying generative AI/LLM applications, strong Python, RAG, vector/graph DBs, AWS, agentic frameworks, LLMOps, and excellent communication.
Python, Retrieval-Augmented Generation (RAG), Model Context Protocol (MCP), AWS, LLMOps, vector databases, graph databases
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior AI Platform Engineer - Frisco
Frisco or San Jose
$107k-$176k/yr HybridFull Time
McAfee
McAfee: Provides cybersecurity and privacy protection software for consumers.
10+ YOE10+ years platform engineering experience with GenAI/LLM ecosystems, Kubernetes (EKS/GKE), cloud (AWS/GCP), Python and Go, Terraform, Backstage, CI/CD, vector stores/OpenSearch, Kafka, and enterprise AI security and governance.
AWS Bedrock, OpenAI, Anthropic, Kubernetes, GKE, EKS, Python, Go, FastAPI, gRPC, AWS, GCP, Terraform, Backstage, OpenSearch, Aurora pgvector, CI/CD, Apache Kafka, LangChain, LlamaIndex, Pinecone, Weaviate, IAM, VPC, KMS, MLOps, LLMOps
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Developer Relations Manager – AgentOps
Santa Clara, California, United States
$224k-$431k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
12+ YOE12+ years experience; BS/MS/PhD in CS/Engineering; leadership; expertise in AgentOps, GenAIOps, LLMOps, generative/agentic AI; strong communication and collaboration.
CUDA, CUDA-x libraries, Nemotron, NIM, NeMo, Agent Toolkits, Blueprints
Job PostingView all
1w
Save
Mark Applied
Hide
Software Engineer II – AI Engineer (w/ skills in Deployment)
San Ramon, California, United States
$85k-$124k/yr RemoteFull Time
Robert Half
Robert HalfNYSE: RHI: Provides specialized staffing and global business consulting services.
4+ YOE4+ years IT experience with 2+ years software engineering and 1+ year GenAI deployment; experience with LLMs, RAG, prompt engineering, CI/CD, containers, cloud platforms, and observability.
Python, Java, C#, JavaScript, SQL, LangChain, Semantic Kernel, AutoGen, CI/CD, Azure, AWS, GCP, LLMOps, MLOps
Job PostingView all
1d
Save
Mark Applied
Hide
AI Engineer
Santa Clara, California, United States
$64k-$115k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
5+ YOE5+ years AI/ML experience, 1+ year building agentic AI, strong Python, LangGraph/LangChain and LLM experience, prompt engineering, cloud AI platforms, APIs, CI/CD, enterprise deployment and leadership skills.
Python, LangGraph, LangChain, LLMs, GPT, Claude, Llama, Azure AI Foundry, AWS Bedrock, Google Gemini Enterprise, APIs, CI/CD, Claude Code, Codex, Databricks, MLOps, LLMOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Engagement Tech Lead, Developer Relations - AI Agents
Santa Clara, California, United States
$224k-$431k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
12+ YOEBS/MS/PhD in CS/Engineering or equivalent, 12+ years experience, expertise in AgentOps/GenAIOps/LLMOps/generative and agentic AI, strong leadership, communication, and ecosystem development skills.
NVIDIA Cuda-x libraries, Nemotron, NIM, NeMo libraries, Agent Toolkits, Blueprints, NVIDIA GPUs, SDKs
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Software Engineer
San Francisco, California, United States
OnsiteFull Time
Workato
Workato: Enterprise platform for automating business workflows and integrating applications.
5+ YOE5+ years professional software development; Bachelor’s or Master’s in CS/Engineering/Information Systems or equivalent experience; proficient in Go, Python, Ruby, or JavaScript; experience with LLMs and deploying ML services.
Go, Python, Ruby, JavaScript, LLM, LLMops, MLops
Job PostingView all
1mo
Save
Mark Applied
Hide
Distinguished AI Engineer
Richmond or Indianapolis or Walnut Creek or Seattle or Grand Prairie or Winston-Salem or Chicago or Atlanta or Miami or Nashville or Tampa or Woburn or Norfolk
$231k-$417k/yr HybridFull Time
Elevance Health
Elevance HealthNYSE: ELV: Provides health insurance plans and integrated healthcare services.
15+ YOEBachelor's in CS/IT (or equivalent) and 15+ years software engineering experience; production AI/ML, LLM and agentic systems experience; strong Python/Java skills; APIs, microservices, cloud, CI/CD and DevOps experience required.
Python, Java, APIs, microservices, event-driven architectures, cloud platforms, CI/CD, DevOps, MLOps, LLMOps, Large Language Models (LLMs), agentic systems, distributed systems
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Engineer, Marketing Technology
San Francisco, California, United States
$155k-$170k/yr HybridFull Time
Sephora
SephoraEuronext Paris: MC: Retailer of beauty products including cosmetics, skincare, and fragrance.
7+ YOE7+ years building large-scale data warehouse and full-stack engineering solutions; experience with ETL, cloud (GCP/Azure), ML, AI-augmented engineering, Python/R/SQL, and strong communication and problem-solving skills.
GitHub Copilot, Claude/Claude Code, Informatica, Pentaho, Data Stage, Python, R, SQL, Scala, Shell, Perl, GCP, GMP, Azure, Agentic AI Tools, AI-SDLC, open-source LLMs, LLMOPS, Machine Learning as a Service (MLAAS)
Job PostingView all
1w
Save
Mark Applied
Hide
AI Principal Engineer - Clinical Data Analytics
Alameda, California, United States
$172k-$245k/yr OnsiteFull Time
Exelixis
ExelixisNASDAQ: EXEL: Discovers and commercializes innovative medicines for cancer treatment.
9+ YOEAdvanced experience in Databricks/Unity Catalog/Delta Lake, Python and SQL, data architecture and governance, MLOps/LLMOps, cloud (AWS) SaaS infra, BI tooling, and 9+ years of related experience (Master's) or 11+ (Bachelor's).
Databricks, Unity Catalog, Delta Lake, Python, SQP, R, Atlan, Colibra, Reltio, Spotfire, Tableau, Power BI, SE, EC2, Lambda, Glue, Redshift
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Software Engineer, AI Platform
Oakland, California, United States
$173k-$251k/yr HybridFull Time
Everlaw
Everlaw: Provides a cloud-based litigation platform for legal teams.
4+ YOE4+ years building distributed cloud software; 1+ year leading multi-developer efforts; strong AI/ML and retrieval systems experience.
AWS, MySQL, PostgreSQL, Vector Database, Graph Database, LLMOps, Cursor, Claude Code
Job PostingView all
1w
Save
Mark Applied
Hide
Global Client Partner
Fremont, California, United States
$230k-$280k/yr OnsiteFull Time
Virtusa
Virtusa: Digital engineering and IT business transformation services provider.
15+ YOE15+ years in digital engineering or professional services, proven enterprise account leadership in HiTech, GenAI/LLMOps and Well-Architected Framework knowledge, strong network with product and engineering leaders.
Helio (GenAI), LLMOps, CI/CD, Well-Architected Framework, microservices, serverless
Job PostingView all
1w
Save
Mark Applied
Hide
Global Client Partner
Fremont, California, United States
OnsiteFull Time
Virtusa
Virtusa: Global provider of digital engineering and IT outsourcing services.
15+ YOE15+ years in digital engineering or professional services selling complex engineering solutions to HiTech accounts; deep HiTech relationships; GenAI/LLMOps and Well-Architected knowledge; strong communication and technical fluency.
Helio (GenAI), LLMOps, CI/CD, Well-Architected Framework, microservices, serverless
Job PostingView all
1w
Save
Mark Applied
Hide
Director, Enterprise Architecture
Burlington or San Francisco or Los Angeles
$195k-$270k/yr RemoteFull Time
HERE Technologies
HERE Technologies: Provides digital mapping data and location-based software services.
8+ YOE15+ years experience leading enterprise architecture and AI transformation, cloud and distributed systems expertise, people management, governance and cross-functional influence.
LLMOps, MLOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Director, Data Engineering & AI
Chicago or Dallas or Los Angeles or Minneapolis or New York or San Francisco or Seattle or Washington, D.C.
$200k-$250k/yr HybridFull Time
West Monroe
West Monroe: Business and technology consultancy specializing in digital transformation.
10+ YOE10+ years in client-facing consulting; deep data platform expertise (Databricks, GCP, Snowflake); AI data engineering and scalable data architectures; travel 30-50%; hybrid work arrangement.
Databricks, GCP, Snowflake, AWS, Azure, MLOps, LLMOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Member of Technical Staff — Audio and Voice AI
San Francisco or New York City
$220k-$320k/yr OnsiteFull Time
Stuut
Stuut: Automates business accounts receivable and collections through AI agents.
5+ YOE5+ years software engineering experience with 2+ years in applied AI/ML or speech/audio systems; production experience with speech-to-text, text-to-speech, LLM integration, real-time systems, deployment pipelines, monitoring, and A/B testing.
Python, PyTorch, TensorFlow, Transformers, LLMOps, MLOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Director, Data Science & AI Engineering
Nashville or Washington D.C. or Los Angeles or San Francisco or New York City
$290k-$440k/yr OnsiteFull Time
Pillsbury Winthrop Shaw Pittman
Pillsbury Winthrop Shaw Pittman: International law firm providing comprehensive legal and strategic advisory.
10+ YOE10+ years data science/AI leadership; production AI/ML, LLMs, RAG, MLOps; strong architecture and governance; strategic and hands-on.
LLMs, RAG, vector databases, embeddings, hybrid search, Model Context Protocol (MCP), prompt engineering, MLOps, LLMOps, CI/CD, cloud infrastructure, data warehouses, BI dashboards
Job PostingView all

Explore Jobs

Expand Your Job Search