9 model serving engineer jobs at 7 companies in Gustine, CA
🚀PromotedHiringCafe
ML Engineer - Inference & Model Deployment
Cupertino, CA, US
$250k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Turn powerful AI and ML models into fast, reliable production systems. Own inference latency, throughput, model-serving architecture, multi-GPU systems, and production deployment for millions of users.
RokuNASDAQ: ROKU: Operates a TV streaming platform and sells streaming hardware.
10+ YOE10+ years applying machine learning and optimization to production systems; deep statistics/ML expertise; production ML lifecycle experience (feature engineering, model serving, monitoring); strong software skills in Python, SQL, Java/Scala; excellent communication.
Senior Machine Learning Engineer, Model Serving Infrastructure (Multiple Positions)
San Jose, California, United States
$265k-$388k/yrOnsiteFull Time
ByteDance: Developing AI-driven content platforms and mobile applications.
2+ YOEMaster's (plus 2 years) or Bachelor's (plus 5 years) in a quantitative field; 2+ years coding in Python or C++; Linux development experience; ML, system design, and production deployment experience.
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
5+ YOE5+ years building and operating ML systems with GPU workloads, designing large-scale cloud services, optimizing model inference, and collaborating with research and engineering teams; proficiency with Python, PyTorch/TensorFlow, model serving tools, containerization, orchestration, and AWS.
KlearNow.AI: AI platform for digital customs brokerage and logistics management.
Engineering leader with hands-on DevSecOps experience across AWS and GCP, CI/CD and IaC expertise, AI infrastructure (GPU/compute provisioning, model serving), cloud security, and scripting in Python/Bash/Go/Java.
Sr. Staff AI Engineer - On-Prem AI Infrastructure & Agentic Systems
San Jose, California, United States
$140k-$165k/yrOnsiteFull Time
SK hynix Memory Solutions AmericaKorea Exchange: 000660: Develops semiconductor controllers and firmware for enterprise data storage.
2+ YOE2+ years in AI/ML engineering with on-prem/private-cloud deployment, experience building agentic AI and RAG pipelines, model fine-tuning (LoRA/QLoRA), Python/Linux/Docker/Kubernetes proficiency, and familiarity with vector DBs and AI serving frameworks.
5+ YOEBachelor's degree or equivalent experience, 5+ years Android development with Kotlin/Java, client-side performance optimization, EMR not applicable; experience with on-device model serving and privacy reviews preferred.
2+ YOEBachelor's degree or equivalent experience; 2+ years Android and Kotlin development; B.S./higher preferred; experience with data structures/algorithms, on-device model serving or LLM orchestration, and privacy/PII practices.
Spring or San Jose or Durham or Fort Collins or Andover
$170k-$413k/yrHybridFull Time
Hewlett Packard EnterpriseNYSE: HPE: Provides edge-to-cloud IT infrastructure and platform services.
15+ YOE5+ MgmtBachelor's in CS/engineering required; 15+ years product experience with 5+ years leading product teams in AI/ML or data infrastructure. Experience with AI platforms, model serving, GPU ecosystems, GTM and monetization.
Spring or San Jose or Durham or Fort Collins or Andover
$170k-$413k/yrHybridFull Time
Hewlett Packard EnterpriseNYSE: HPE: Provides global edge-to-cloud technology solutions and IT infrastructure services.
15+ YOE5+ MgmtBachelor's in CS/engineering required; 15+ years product management experience with 5+ years AI/ML product leadership; experience building AI/ML platforms, inference/model serving, GPU ecosystem, executive communication, and GTM strategy.
GreenLake, GenAI, GPU, agent frameworks, AI tools, MLOps, DevOps, SaaS