83 distribution modeling engineer jobs at 32 companies in Marina, CA
2mo
Save
Mark Applied
Hide
Distinguished Engineer - AI
San Jose, California, United States
$266k-$396k/yr OnsiteFull Time
15+ YOEExpert in AI inferencing and distributed systems at scale with 15+ years experience; hands-on with inference engines, model optimization, GPU/TPU orchestration, Kubernetes, RDMA/DPDK; strong architecture, communication, and mentorship skills.
TensorRT, vLLM, ONNX Runtime, Triton, RDMA, DPDK, Kubernetes, GPU, TPU
2mo
Save
Mark Applied
Hide
Senior Production Engineer
San Francisco or Sunnyvale
$209k-$253k/yr OnsiteFull Time
Senior production engineer with distributed systems experience, hands-on with large language models, SRE mindset, and strong programming skills (Python, Go, Java, or C++), Kubernetes knowledge, and collaborative skills.
Python, Go, Java, C++, Kubernetes
2w
Save
Mark Applied
Hide
Staff Software Engineer, Data Center Resource Modeling
Sunnyvale, California, United States
$207k-$300k/yr OnsiteFull Time
8+ YOE3+ MgmtBachelor's degree or equivalent, 8 years programming experience, 5 years launching software and building large-scale infrastructure, 3 years software architecture, and distributed computing experience.
C++, Java
3d
Save
Mark Applied
Hide
Staff Machine Learning Engineer
Santa Clara, California, United States
$176k-$308k/yr OnsiteFull Time
6+ YOERequires 6+ years building reliable, scalable production software; experience shipping generative AI products, prompt and evaluation engineering, distributed systems, API design, testing, model cost and latency optimization.
Kubernetes, OpenShift, CMDB, Workflow Data Fabric, Knowledge Graph, RAG, Anthropic, Google, OpenAI, Microsoft ServiceNow
1w
Save
Mark Applied
Hide
Cloud Engineer III, Falcon Exposure Management (Hybrid)
Sunnyvale or New York City or Austin or Redmond
$120k-$180k/yr HybridFull Time
5+ YOE5+ years building production systems at scale; proficiency in Go, Python, or Java; distributed systems expertise; production LLM and agentic systems experience; frontier-model SDK experience; strong engineering judgment.
Go, Python, Java, Anthropic, OpenAI, RAG, E-Verify
2mo
Save
Mark Applied
Hide
Distinguished Engineer - AI (San Jose, CA, US, 95128)
San Jose, California, United States
$266k-$396k/yr OnsiteFull Time
15+ YOE15+ years building low-latency, fault-tolerant distributed systems and AI/ML inference platforms; expertise with inference engines, model optimization, storage for AI, RDMA/DPDK, and Kubernetes-based orchestration.
TensorRT, vLLM, ONNX Runtime, Triton, RDMA, DPDK, Kubernetes
2mo
Save
Mark Applied
Hide
Senior AI / Machine Learning Engineer
San Francisco or New York City or San Jose or Seattle or Austin or Boston
$115k-$200k/yr HybridFull Time
5+ YOE5+ years ML industry experience, proven production-scale model training, expertise with LLMs/diffusion/GNNs, strong PyTorch skills, distributed training and data-pipeline experience, and solid software engineering practices.
PyTorch, GitHub
2mo
Save
Mark Applied
Hide
Distributed Systems Engineer 4 - Content & Business Products
Los Gatos or United States
$250k-$413k/yr RemoteFull Time
2+ YOE2+ years working on distributed systems; proficiency in Java or C# and OO design; experience with multithreading, microservices, data modeling, API design; participate in on-call rotation and lead incident reviews.
Java, C#, gRPC, GraphQL, S3
2mo
Save
Mark Applied
Hide
Principal Engineer, Model Development Platform
Sunnyvale, California, United States
$296k-$335k/yr HybridFull Time
10+ YOE10+ years building large-scale distributed systems or ML infrastructure, 3+ years at staff/principal level, experience with Spark, Ray, Kubernetes, Airflow, MLflow, web frameworks, reliability engineering, and mentoring engineers.
Spark, Ray, Kubernetes, Airflow, MLflow, React, Flask, FastAPI
1w
Save
Mark Applied
Hide
Staff Software Engineer - Engineer
Sunnyvale or San Francisco or Seattle
$232k-$258k/yr OnsiteFull Time
9+ YOE9+ years developing ML models; bachelor's degree in computer science, computer engineering, or related field; experience with ML frameworks, foundational models or LLMs, MLOps, ML infrastructure, and distributed systems.
PyTorch, TensorFlow, Kubernetes, MLOps, Large Language Models (LLMs)
1mo
Save
Mark Applied
Hide
Tech Lead Software Engineer - AI Compute Infrastructure
San Jose, California, United States
OnsiteFull Time
5+ YOE5+ years experience building cloud/ML infrastructure, strong knowledge of large-model inference, distributed systems, scheduling, and container orchestration; proficiency in Go/Rust/Python/C++.
vLLM, SGLang, TensorRT-LLM, Kubernetes, Ray, Docker, CUDA, AWS, Azure, GCP, SageMaker, Azure ML, Vertex AI, DeepSpeed, PyTorch, Go, Rust, Python, C++
1mo
Save
Mark Applied
Hide
Systems Design/Architecture Engineer 5
Seattle or San Jose
$149k-$293k/yr OnsiteFull Time
15+ YOE15+ years systems and architecture experience, 10+ years in distributed computing, expertise in IAM, cryptography, network/cloud/application security, threat modeling, and strong communication; bachelor’s or equivalent.
AWS, Azure, GCP
1mo
Save
Mark Applied
Hide
Machine Learning Engineer, TikTok - Business Governance
San Jose, California, United States
$156k-$388k/yr OnsiteFull Time
Strong ML/DL knowledge with Transformer/LLM familiarity, hands-on Python and PyTorch, distributed training and large-scale data processing, experience productionizing models for content safety and cross-team collaboration.
Python, PyTorch
3d
Save
Mark Applied
Hide
Research Engineer
San Jose or New York City
$200k-$300k/yr OnsiteFull Time
Significant language-model training or post-training experience, RL tuning, Python and PyTorch or JAX proficiency, distributed GPU training, empirical experimentation, and strong software engineering and writing skills.
SAP, Salesforce, Workday, Oracle, Snowflake, MuleSoft, Python, PyTorch, JAX, vLLM, SGLang, Triton, DeepSpeed, Ray, Megatron, TRL
2mo
Save
Mark Applied
Hide
Senior Systems Software Engineer, Accelerated Kubernetes Performance and Scale - DGX Cloud
Santa Clara or Seattle
$184k-$357k/yr HybridFull Time
8+ YOE8+ years experience in computer architecture, networking, storage or accelerator platforms; expertise in Kubernetes, distributed systems, performance modeling; proficiency in Golang and/or Python; experience with major public cloud providers.
Kubernetes, GPU Operator, Network Operator, node-feature-discovery, topograph, dra-driver-nvidia-gpu, nvsentinel, Grove, gateway-api-inference-extension, DSX, Golang, Python, AWS, Azure, GCP, OCI
3mo
Save
Mark Applied
Hide
Staff Machine Learning Engineer - Agentic Models, LLM, RAG, GenAI
Santa Clara, California, United States
$232k-$310k/yr HybridFull Time
6+ YOELead AI/ML engineer with 6+ years in ML, Gen AI, LLMs; strong Python, TensorFlow/PyTorch; AWS, Docker, Kubernetes; expert in agentic AI and distributed systems.
Python, TensorFlow, PyTorch, AWS, Docker, Kubernetes
2mo
Save
Mark Applied
Hide
ML Engineer - Inference & Model Deployment
Cupertino, California, United States
$250k-$310k/yr OnsiteFull Time
Experience deploying and optimizing deep learning models in production, multi-GPU inference, profiling/benchmarking model performance, inference optimization techniques, and cloud/distributed systems familiarity.
vLLM, TensorRT, SGLang, GPU
1mo
Save
Mark Applied
Hide
Senior Systems Software Engineer, Accelerated Kubernetes Performance and Scale - DGX Cloud
Santa Clara or Seattle or United States
$152k-$242k/yr HybridFull Time
5+ YOEBachelor's degree or equivalent experience, 5+ years in computer architecture, networking, storage or accelerator platforms; expertise in Kubernetes, distributed systems, performance modeling, Golang/Python, and major public cloud providers.
Kubernetes, GPU Operator, Network Operator, node-feature-discovery, topograph, dra-driver-nvidia-gpu, nvsentinel, Grove, gateway-api-inference-extension, DSX, Golang, Python, AWS, Azure, GCP, OCI, CI/CD
3mo
Save
Mark Applied
Hide
Lead Machine Learning Engineer - Agentic Models, LLM, RAG, GenAI
Santa Clara, California, United States
$193k-$258k/yr HybridFull Time
5+ YOESenior ML engineer with expertise in AI agents, LLMs, distributed systems; 5-7+ years of experience; strong Python and ML frameworks; AWS; Docker/Kubernetes; RAG/GenAI experience.
Python, TensorFlow, PyTorch, AWS, Docker, Kubernetes, Kafka, AWS SQS, LangGraph, CrewAI, AutoGen, Pinecone, pgvector, vLLM, TensorRT-LLM
2mo
Save
Mark Applied
Hide
Principal Engineer, Model Development Platform
Sunnyvale, California, United States
$296k-$335k/yr HybridFull Time
10+ YOE10+ years building large-scale distributed systems or ML infrastructure, 3+ years at staff/principal level, experience with Spark, Ray, Kubernetes, Airflow, MLflow, reliability/observability, mentoring, and optimization or scheduling systems.
Spark, Ray, Kubernetes, Airflow, MLflow, React, Flask, FastAPI