4 inference engineer jobs at 3 companies in Illinois
6d
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Chicago or New York City or San Francisco or Seattle or Sunnyvale
$182k-$202k/yr OnsiteFull Time
4+ YOE4+ years building ML models; BS in CS/CE or related; experience with PyTorch, causal inference or constrained optimization preferred; product and marketplace experience a plus.
PyTorch
1w
Save
Mark Applied
Hide
Engineering Manager, Deep Learning Inference
Santa Clara or Georgia or District of Columbia or Illinois or California or Massachusetts
$224k-$431k/yr HybridFull Time
6+ YOE3+ MgmtMS/PhD or equivalent, 6+ years software experience with 3+ years technical leadership; strong C/C++ and Python; GPU programming and performance optimization experience; experience with deep learning model deployment.
SGLang, vLLM, FlashInfer, C, C++, Python, CUDA, Triton, CUTLASS, NIXL, NCCL, NVSHMEM, PyTorch, TensorRT-LLM
1w
Save
Mark Applied
Hide
Engineering Manager, Deep Learning Inference
Santa Clara or Washington or Georgia or Illinois or California or Massachusetts
$224k-$431k/yr HybridFull Time
6+ YOE3+ MgmtMS/PhD or equivalent,6+ years software development with 3+ years technical leadership,strong C/C++ and Python,experience with GPU programming (CUDA,Triton,CUTLASS) and deploying/optimizing deep learning models,Agile experience.
SGLang, vLLM, FlashInfer, C/C++, Python, CUDA, Triton, CUTLASS, NIXL, NCCL, NVSHMEM, PyTorch, TensorRT-LLM
2mo
Save
Mark Applied
Hide
Sr. Software Engineer
Wayne or Naperville
$120k-$135k/yr HybridFull Time
5+ YOE5–7 years backend engineering or intelligent systems with production impact; strong Python, CI/CD, and system design; experience with ML model APIs and cloud inference; familiarity with vector databases and retrieval systems.
Python, CI/CD, AWS Bedrock, Azure OpenAI, Google Vertex AI, PyTorch, Hugging Face Transformers, vLLM, FAISS, Pinecone, OpenSearch/KNN, LangChain, LlamaIndex, MLflow, Weights & Biases, Prometheus