18 inference optimization engineer jobs at 11 companies in Cranston, RI
1mo
Save
Mark Applied
Hide
Staff Engineer, Inference Optimizations
Boston, Massachusetts, United States
$191k-$239k/yr RemoteFull Time
5+ YOE5+ years in high-performance computing or AI infrastructure, deep GPU and inference optimization expertise, experience with CUDA/Triton/ROCm, attention-layer and kernel-level optimization, strong system design and leadership through influence.
AITER, CUDA, ROCm, TensorRT, Triton, FlashAttention
1w
Save
Mark Applied
Hide
Senior Inference Engineer, AGI
Sunnyvale or Boston or Seattle or Los Angeles County
$193k-$262k/yr OnsiteFull Time
5+ YOERequires 5+ years software development, 4+ years systems architecture, a computer science bachelor's degree, 2+ years neural inference optimization, GPU optimization, real-time systems, and technical leadership experience.
Nsight Compute, Nsight Systems, vLLM, PyTorch, TensorRT-LLM, CUTLASS, Triton, CUDA, PTX, FlashAttention, NCCL, NVLink, AWS Neuron, Trainium, Microsoft Excel
2mo
Save
Mark Applied
Hide
Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform)
San Jose or San Francisco or New York City or Cambridge or McLean
$230k-$286k/yr OnsiteFull Time
6+ YOEBachelor's plus 6 years or master's plus 4 years developing AI/ML technologies, and 6 years programming with Python, Go, Scala, or Java. Cloud AI deployment and team leadership are preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch, Python, Go, Scala, Java, AWS, Google Cloud, Azure, C++, C#, Golang
3w
Save
Mark Applied
Hide
Staff/Principal DevOps Engineer, AI Inference
Cambridge, Massachusetts, United States
$192k-$272k/yr OnsiteFull Time
Expertise operating GPU/accelerator infrastructure for ML, Kubernetes and AWS deployment experience, infrastructure-as-code (Terraform, Helm), Python proficiency, networking and performance optimization for low-latency inference.
Kubernetes, vLLM, Triton Inference Server, TGI, Terraform, Helm, EKS, EC2, S3, EFA, IAM, NCCL, Python, Rust, Go, CUDA
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (FM Hosting, LLM Inference)
New York or McLean or Cambridge or San Jose
$251k-$286k/yr OnsiteFull Time
6+ YOEBachelor's in CS/AI/EE/CE or related with 6+ years (or Master's with 4+ years); 6+ years programming with Python, Go, Scala, or Java; experience deploying scalable AI systems, LLM inference, similarity search, and optimization of training/inference.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure
2mo
Save
Mark Applied
Hide
Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform)
San Jose or San Francisco or New York City or Cambridge or McLean
$230k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java; cloud AI deployment experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
1mo
Save
Mark Applied
Hide
Staff Embedded ML Engineer, Edge AI
Boston, Massachusetts, United States
$186k-$245k/yr HybridFull Time
8+ YOE8+ years embedded/performance engineering experience, strong C/C++ skills, experience optimizing on-device ML inference and runtimes (TFLite/ONNX/TensorRT), profiling and debugging performance under constrained hardware.
C, C++, TFLite, ONNX Runtime, TensorRT, XNNPACK, QNNPACK, oneDNN, CMSIS-NN, perf, flame graphs
2mo
Save
Mark Applied
Hide
Lead AI Engineer (Vision model customization, VLM)
New York or Cambridge or McLean or San Jose
$197k-$246k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE + 4 years AI/ML experience (or Master's + 2 years). 4+ years programming with Python/Go/Scala/Java. Experience with LLM inference, similarity search/VectorDBs, cloud deployments, PyTorch, and optimizing training/inference.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure, LLM
1mo
Save
Mark Applied
Hide
Systems ML Engineer (Member of the Technical Staff)
Cambridge, Massachusetts, United States
OnsiteFull Time
Experience optimizing and deploying large-scale ML models for training and inference, profiling and custom GPU kernel development, distributed training, cloud and edge deployment, and infrastructure automation.
Nsight, PyTorch Profiler, PyTorch Distributed, PyTorch, JAX, Triton, CUDA, Kubernetes, Terraform, AWS, NCCL
2mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York or San Francisco or McLean or Cambridge or San Jose or Plano
$209k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE +6 years or Master's +4 years; 6+ years programming with Python/Go/Scala/Java; experience deploying scalable AI on cloud; LLM, inference, similarity search, VectorDBs, guardrails, model evaluation, and optimization experience; leadership and research literacy.
Python, Go, Scala, Java, C++, C#, Golang, AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure
2mo
Save
Mark Applied
Hide
AI Systems Engineer
Boston, Massachusetts, United States
OnsiteFull Time
Experience with AI inference and distributed serving, strong systems and GPU optimization skills, proficiency in Python and PyTorch, familiarity with inference frameworks (vLLM, Triton, Ray Serve); PhD or equivalent experience preferred.
vLLM, PyTorch, Triton inference server, Ray Serve, CUDA, Python
1mo
Save
Mark Applied
Hide
Senior Software Engineer - GPU Local AI Platforms
Santa Clara or Westford or Austin or Durham or Seattle
$224k-$431k/yr OnsiteFull Time
12+ YOE12+ years software engineering experience in GPU computing or ML systems, strong Python or C++ skills, GPU kernel optimization (CUDA/Triton), container engineering, and LLM inference knowledge.
Python, C++, CUDA, Triton, Docker, OCI, NCCL, RCCL, NVIDIA Container Toolkit
2mo
Save
Mark Applied
Hide
Senior AI Engineer (US)
Boston or New York City
HybridFull Time
5+ YOE5+ years building production ML/AI systems with 2+ years on LLMs/agents; deep Python; fine-tuning (SFT, DPO/GRPO, RLHF/RLAIF); transformer expertise; PyTorch/Hugging Face/DeepSpeed stack; inference optimization; retrieval/vector pipelines; Kubernetes.
Python, PyTorch, Hugging Face, DeepSpeed, FSDP, accelerate, vLLM, TensorRT-LLM, Kubernetes
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform Services)
San Jose or McLean or Cambridge or New York City
$251k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE plus 6+ years, or Master's plus 4+ years; 6+ years programming with Python, Go, Scala or Java; experience deploying scalable AI systems, LLM inference, vector databases, and optimization techniques; strong communication and leadership.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure, LLM
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer(MLX, Agentic AI, Gen AI platform Services)
San Jose or San Francisco or McLean or Cambridge or New York City
$230k-$286k/yr OnsiteFull Time
6+ YOE6+ years developing AI/ML systems (or 4+ with a master\u0002s), strong software and math foundations, experience with LLM inference, similarity search, and optimization, Python/Go/Scala/Java proficiency, cloud deployment experience.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure
2mo
Save
Mark Applied
Hide
Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)
Cambridge or McLean or New York or San Jose or United States
$197k-$246k/yr OnsiteFull Time
2+ YOEBachelor's in CS/AI/EE/CE (4+ yrs) or Master's (2+ yrs). 4+ yrs programming in Python, Go, Scala, or Java. Experience with LLMs, model training/inference, vector search, cloud deployments, and AI system optimization.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure
3mo
Save
Mark Applied
Hide
Software Solutions Architect
Austin or Boxborough or Markham
$212k-$318k/yr OnsiteFull Time
Architect and deliver enterprise software solutions leveraging AMD GPUs/APUs; engage customers and partners; strong software engineering, AI inference stack and performance optimization experience.
ROCm, ONNX Runtime, ONNX, PyTorch, TensorRT, CUDA, Docker, Kubernetes, C, C++, Python
1w
Save
Mark Applied
Hide
Member of Technical Staff, Performance & Capacity
Boston, Massachusetts, United States
HybridFull Time
5+ YOERequires 5+ years with GPU and large-scale multi-node compute workloads, distributed training performance, networking, parallel file systems, AI training and inference optimization, and capacity decisions.
GPU, H100, B200, InfiniBand, RDMA, parallel file systems
Explore Jobs
Expand Your Job Search
Top Cities Near Cranston for Inference Optimization Engineer
- Inference Optimization Engineer jobs in Boston, MA
- Inference Optimization Engineer jobs in Worcester, MA
- Inference Optimization Engineer jobs in Providence, RI
- Inference Optimization Engineer jobs in Cambridge, MA
- Inference Optimization Engineer jobs in New Bedford, MA
- Inference Optimization Engineer jobs in Brockton, MA
- Inference Optimization Engineer jobs in Fall River, MA
- Inference Optimization Engineer jobs in Quincy, MA
- Inference Optimization Engineer jobs in Newton, MA
- Inference Optimization Engineer jobs in Warwick, RI
- Inference Optimization Engineer jobs in Somerville, MA
- Inference Optimization Engineer jobs in Pawtucket, RI
- Inference Optimization Engineer jobs in Framingham, MA
- Inference Optimization Engineer jobs in Waltham, MA
- Inference Optimization Engineer jobs in Malden, MA
- Inference Optimization Engineer jobs in Brookline, MA
- Inference Optimization Engineer jobs in Medford, MA
- Inference Optimization Engineer jobs in Taunton, MA
- Inference Optimization Engineer jobs in Revere, MA
- Inference Optimization Engineer jobs in East Providence, RI