16 gpu inference performance engineer jobs at 16 companies in Vallejo, CA
3d
Save
Mark Applied
Hide
Inference Performance Engineer
San Francisco, California, United States
HybridFull Time
5+ YOE5+ years in ML systems, inference infrastructure, or performance engineering; model-serving expertise; Python and systems-language proficiency; and GPU performance experience with measurable cost or latency improvements.
vLLM, SGLang, TensorRT-LLM, Python, C++, Rust, CUDA, NCCL
1mo
Save
Mark Applied
Hide
Staff Engineer, Inference Optimizations
San Francisco, California, United States
$191k-$239k/yr RemoteFull Time
5+ YOE5+ years in high-performance computing or AI infrastructure, deep GPU and low-level optimization expertise, experience with CUDA/Triton/ROCm, distributed GPU parallelization, and system design for inference workloads.
CUDA, ROCm, TensorRT, OpenAI Triton, AITER, FlashAttention
3mo
Save
Mark Applied
Hide
ML Inference Engineer
San Francisco, California, United States
OnsiteFull Time
Strong expertise in ML engineering, PyTorch, CUDA, and high-performance inference; experience with diffusion models and low-latency systems.
PyTorch, TensorRT, TransformerEngine, Nsight, ONNX Runtime, CUDA
1mo
Save
Mark Applied
Hide
GPU Kernel Engineer
San Francisco, California, United States
$180k-$280k/yr OnsiteFull Time
Deep CUDA/GPU kernel expertise, experience building and optimizing training and inference kernels, LLM training experience, profiling and eliminating performance bottlenecks.
CUDA, CuTe DSL
3mo
Save
Mark Applied
Hide
Founding Engineer - ML Performance
San Francisco, California, United States
$250k-$395k/yr RemoteFull Time
Hands-on CUDA, GPU optimization, and large-scale model inference experience; strong systems and performance engineering skills.
CUDA, GPU, NCCL, PyTorch, Triton, TensorRT, CUDA kernels
3mo
Save
Mark Applied
Hide
Performance Engineer
Palo Alto, California, United States
OnsiteFull Time
Strong systems engineering in performance-critical software; GPU/distributed systems; profiling tools; Python and C++; CUDA/Triton/ROCm/XLA familiarity; LLM inference concepts; ability to debug across software, hardware, and infra layers; strong communication.
CUDA, Triton, Pallas, ROCm, XLA, Python, C++
2mo
Save
Mark Applied
Hide
ML Systems & Performance Engineer
San Francisco, California, United States
OnsiteFull Time
5+ YOE5+ years building training/inference systems; strong engineering skills; experience with ML frameworks, GPUs, distributed systems; bachelor's degree or equivalent experience.
PyTorch, JAX, GPUs
2mo
Save
Mark Applied
Hide
Member of Technical Staff, Inference
San Francisco, California, United States
OnsiteFull Time
Deep expertise in large-model inference, GPU performance engineering, kernel development (CUDA/Triton), Python and PyTorch, distributed systems, and production model deployment.
CUDA, Triton, Python, PyTorch, vLLM, TensorRT-LLM, SGLang, DeepSpeed
2w
Save
Mark Applied
Hide
AI Performance Modeling Engineer
Burlingame, California, United States
$180k-$225k/yr HybridFull Time
Strong Python and quantitative modeling skills; computer architecture knowledge; technical writing ability; AI inference or performance modeling expertise; BS, MS, PhD, or equivalent practical experience.
Python, C++, CUDA, Triton, gem5, Timeloop, MAESTRO, Accel-Sim
2mo
Save
Mark Applied
Hide
Software Engineer, ML Performance Optimization
Foster City, California, United States
$192k-$257k/yr OnsiteFull Time
4+ YOE4+ years total exp; 2+ years in large-scale model training or inference; PyTorch; GPU-accelerated inference; profiling tools; Python or C++.
PyTorch, TensorRT, NVIDIA Nsight, Python, C++
2mo
Save
Mark Applied
Hide
Member of Technical Staff, Inference
San Francisco, California, United States
$350k-$500k/yr OnsiteFull Time
Experience owning inference systems, optimizing inference performance on GPU/accelerator hardware, and extending distributed inference frameworks for high-throughput, low-latency serving.
vLLM, SGLang, TensorRT-LLM
2mo
Save
Mark Applied
Hide
Staff+ Software Engineer, Inference Runtime
San Francisco or Seattle or New York City
$405k-$485k/yr HybridFull Time
Senior IC with deep systems or ML infrastructure experience, hands-on performance profiling and optimization, accelerator ecosystem expertise (CUDA/TPU/Trainium), strong software engineering and cross-org alignment skills, and a relevant bachelor’s degree or equivalent.
Rust, Python, CUDA, XLA, Triton, NeuronX, AWS Neuron, Kubernetes, CI/CD
1w
Save
Mark Applied
Hide
Member of Technical Staff, ML Inference Engineering
Palo Alto, California, United States
OnsiteFull Time
5+ YOERequires 5+ years writing high-performance code, NVIDIA GPU and CUDA expertise, LLM serving knowledge, and research or systems experience in language or speech inference. Production-scale systems experience preferred.
CUDA, Triton, Kubernetes, InfiniBand, RoCE, LoRA
1mo
Save
Mark Applied
Hide
Staff Machine Learning Engineer
California or San Francisco or Mountain View
$167k-$251k/yr RemoteFull Time
5+ YOE5+ years in software/ML engineering with on-device or performance-critical systems; production deployment of transformer/diffusion models on-device; experience with inference runtimes, quantization, operator fusion, and GPU/compute APIs; strong Python; communication and mentoring skills.
WebGPU, WebNN, WGSL, Metal, Vulkan, SPIR-V, CUDA, ONNX Runtime Web, ONNX Runtime, Transformers.js, WebLLM, TensorFlow.js, CoreML, TFLite, ExecuTorch, Chrome, Dawn, PIX, Instruments, Snapdragon Profiler, Nsight, RenderDoc, Python, TypeScript, JavaScript, MLIR, TVM, IREE, XLA, C++, Objective-C, Swift
1mo
Save
Mark Applied
Hide
[2026] Senior Machine Learning Engineer (Systems), Embodied AI/NPCs, ML Platform - PhD Early Career
San Mateo, California, United States
$197k-$243k/yr HybridFull Time
PhD (pursuing or completed) in a technical field; experience building end-to-end ML pipelines, model inference and deployment, distributed inference systems, Kubernetes and major cloud providers (AWS/Azure/GCP); strong systems and performance optimization skills.
Kubernetes, AWS, Azure, GCP, GPU, LLMs, Roblox Studio IDE
3mo
Save
Mark Applied
Hide
Member of Technical Staff - Distributed Systems
San Francisco, California, United States
$200k-$300k/yr OnsiteFull Time
Strong distributed systems fundamentals (concurrency, networking, databases, performance engineering). Ability to design, test, and reason about correctness in large-scale systems. Bonus: ML inference and GPU/accelerator experience.
vLLM, SGLang
Explore Jobs
Expand Your Job Search
Top Cities Near Vallejo for Gpu Inference Performance Engineer
- Gpu Inference Performance Engineer jobs in San Francisco, CA
- Gpu Inference Performance Engineer jobs in Oakland, CA
- Gpu Inference Performance Engineer jobs in Fremont, CA
- Gpu Inference Performance Engineer jobs in Santa Rosa, CA
- Gpu Inference Performance Engineer jobs in Hayward, CA
- Gpu Inference Performance Engineer jobs in Concord, CA
- Gpu Inference Performance Engineer jobs in Berkeley, CA
- Gpu Inference Performance Engineer jobs in Fairfield, CA
- Gpu Inference Performance Engineer jobs in Antioch, CA
- Gpu Inference Performance Engineer jobs in Richmond, CA
- Gpu Inference Performance Engineer jobs in Daly City, CA
- Gpu Inference Performance Engineer jobs in San Mateo, CA
- Gpu Inference Performance Engineer jobs in Vacaville, CA
- Gpu Inference Performance Engineer jobs in San Leandro, CA
- Gpu Inference Performance Engineer jobs in Livermore, CA
- Gpu Inference Performance Engineer jobs in Redwood City, CA
- Gpu Inference Performance Engineer jobs in Napa, CA
- Gpu Inference Performance Engineer jobs in Pleasanton, CA
- Gpu Inference Performance Engineer jobs in Alameda, CA
- Gpu Inference Performance Engineer jobs in San Ramon, CA