2 inference optimization engineer jobs at 1 company in Seaside, CA
1w
Save
Mark Applied
Hide
Sr. Software Development Engineer, Inference Team - AWS Neuron
Seattle or Cupertino or Los Angeles County
$168k-$262k/yr OnsiteFull Time
5+ YOERequires 5+ years of software development and programming experience, a computer science degree or equivalent, machine learning optimization experience, and knowledge of inference frameworks and accelerator hardware.
vLLM, SGLang, Java, C++, C#, PyTorch, JAX, AWS Neuron, CUDA, Triton
1mo
Save
Mark Applied
Hide
Software Development Manager, LLM Inference Model Enablement, Neuron SDK
Cupertino, California, United States
$213k-$288k/yr OnsiteFull Time
7+ YOE3+ MgmtManage engineering team to onboard and optimize LLMs for inference on Trainium; strong background in LLM architectures, model performance optimization, and inference techniques; experience with PyTorch and Neuron stack.
PyTorch, AWS Neuron, Neuron compiler, Neuron runtime