12 inference optimization engineer jobs at 3 companies in Virginia
2mo
Save
Mark Applied
Hide
Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform)
San Jose or San Francisco or New York City or Cambridge or McLean
$230k-$286k/yr OnsiteFull Time
6+ YOEBachelor's plus 6 years or master's plus 4 years developing AI/ML technologies, and 6 years programming with Python, Go, Scala, or Java. Cloud AI deployment and team leadership are preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch, Python, Go, Scala, Java, AWS, Google Cloud, Azure, C++, C#, Golang
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (FM Hosting, LLM Inference)
New York or McLean or Cambridge or San Jose
$251k-$286k/yr OnsiteFull Time
6+ YOEBachelor's in CS/AI/EE/CE or related with 6+ years (or Master's with 4+ years); 6+ years programming with Python, Go, Scala, or Java; experience deploying scalable AI systems, LLM inference, similarity search, and optimization of training/inference.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure
2mo
Save
Mark Applied
Hide
Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform)
San Jose or San Francisco or New York City or Cambridge or McLean
$230k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java; cloud AI deployment experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
2mo
Save
Mark Applied
Hide
Lead AI Engineer (Vision model customization, VLM)
New York or Cambridge or McLean or San Jose
$197k-$246k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE + 4 years AI/ML experience (or Master's + 2 years). 4+ years programming with Python/Go/Scala/Java. Experience with LLM inference, similarity search/VectorDBs, cloud deployments, PyTorch, and optimizing training/inference.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure, LLM
1mo
Save
Mark Applied
Hide
AI Implementation Engineer - JobID-0245
Arlington or Mount Laurel
$114k-$231k/yr HybridFull Time
5+ YOEDesign and deliver production-grade on‑prem AI/agent systems, integrate LLMs and tools, build RAG pipelines, optimize local inference, and obtain/maintain Secret clearance.
Python, NumPy, Pandas, vLLM, SGLang, Triton Inference Server, TensorRT-LLM, PyTorch, TensorFlow, LangChain, LangGraph, Semantic Kernel, AutoGen, Linux, Model Context Protocol (MCP), LLM, Retrieval-Augmented Generation (RAG)
2mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York or San Francisco or McLean or Cambridge or San Jose or Plano
$209k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE +6 years or Master's +4 years; 6+ years programming with Python/Go/Scala/Java; experience deploying scalable AI on cloud; LLM, inference, similarity search, VectorDBs, guardrails, model evaluation, and optimization experience; leadership and research literacy.
Python, Go, Scala, Java, C++, C#, Golang, AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure
1mo
Save
Mark Applied
Hide
Lead AI Engineer
McLean or San Jose or Richmond or New York City
$197k-$225k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE +4 yrs (or Master's +2 yrs); 4+ yrs programming with Python, Go, Scala, or Java; experience deploying scalable AI; familiarity with LLM inference, vector DBs, guardrails, and model optimization.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer, Gen AI Platform
New York City or McLean or San Jose
$251k-$286k/yr OnsiteFull Time
6+ YOEDegree in CS/AI/EE or related plus 6+ years AI/ML engineering experience (or MS+4 yrs). Strong Python/Go/Scala/Java skills, cloud AI deployment experience, LLM/Inference and optimization expertise, leadership and communication skills.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform Services)
San Jose or McLean or Cambridge or New York City
$251k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE plus 6+ years, or Master's plus 4+ years; 6+ years programming with Python, Go, Scala or Java; experience deploying scalable AI systems, LLM inference, vector databases, and optimization techniques; strong communication and leadership.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure, LLM
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer(MLX, Agentic AI, Gen AI platform Services)
San Jose or San Francisco or McLean or Cambridge or New York City
$230k-$286k/yr OnsiteFull Time
6+ YOE6+ years developing AI/ML systems (or 4+ with a master\u0002s), strong software and math foundations, experience with LLM inference, similarity search, and optimization, Python/Go/Scala/Java proficiency, cloud deployment experience.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure
2mo
Save
Mark Applied
Hide
Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)
Cambridge or McLean or New York or San Jose or United States
$197k-$246k/yr OnsiteFull Time
2+ YOEBachelor's in CS/AI/EE/CE (4+ yrs) or Master's (2+ yrs). 4+ yrs programming in Python, Go, Scala, or Java. Experience with LLMs, model training/inference, vector search, cloud deployments, and AI system optimization.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure
1mo
Save
Mark Applied
Hide
Sr. GenAI Specialist PSA , Solutions Architecture
Herndon, Virginia, United States
$154k-$208k/yr OnsiteFull Time
7+ YOE7+ years designing and operating distributed applications; 5+ years customer-facing experience building production GenAI/ML systems; hands-on LLM, RAG, agentic workflows, prompt engineering, inference optimization; experience with AWS AI/ML services.
Amazon Bedrock, SageMaker, AgentCore, Bedrock Agents, Strands Agents SDK, LangChain, OpenSearch Serverless, pgvector, Pinecone