28 ai inference engineer jobs at 8 companies in Washington, DC
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (FM Hosting, LLM Inference)
New York City or McLean or San Jose or Cambridge
$230k-$286k/yr OnsiteFull Time
6+ YOEBachelor’s plus 6 years or master’s plus 4 years in AI/ML development; 6 years programming in Python, Go, Scala, or Java; cloud AI deployment and engineering leadership preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, AWS, Google Cloud, Azure, C++, C#, Golang
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (FM Hosting, LLM Inference)
New York or McLean or Cambridge or San Jose
$251k-$286k/yr OnsiteFull Time
6+ YOEBachelor's in CS/AI/EE/CE or related with 6+ years (or Master's with 4+ years); 6+ years programming with Python, Go, Scala, or Java; experience deploying scalable AI systems, LLM inference, similarity search, and optimization of training/inference.
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, Azure
1mo
Save
Mark Applied
Hide
Staff AI Infrastructure Engineer
Austin or Reston
HybridFull Time
8+ YOE8+ years building distributed systems and cloud-native AI infrastructure; strong Python and systems programming skills; Kubernetes, GPU inference, and platform engineering experience; leadership and architecture experience.
Python, Go, Rust, C++, vLLM, SGLang, TensorRT-LLM, Triton Inference Server, Ray Serve, Kubernetes, Helm, Argo CD, Docker, Prometheus, Grafana, OpenTelemetry, Infrastructure-as-Code, GitOps, CI/CD, AWS, Azure, Oracle Cloud Infrastructure, Google Cloud Platform
1mo
Save
Mark Applied
Hide
Senior AI/ML Engineer
United States or Minneapolis or Washington
$120k-$215k/yr RemoteFull Time
3+ YOEBachelor's in CS or quantitative field; 3+ years programming (Python, SQL, packaging), experience with observability, model registry/experiment tracking, responsible AI, GenAI/agents, serving/inference, and cloud platforms.
Python, pytest, SQL, shell, LangChain, Vertex AI, MLflow, AWS, Azure, GPUs, TPUs
3w
Save
Mark Applied
Hide
AI/ML Engineer — Generative AI Mission Systems
Laurel or United States
HybridFull Time
4+ YOE4+ years building LLM, RAG, and prompt-engineered AI; master's or PhD in AI/ML or related; experience with inference pipelines, agentic AI, and delivering LLM-enabled software; strong collaboration and documentation skills.
Kubernetes, OpenShift, WebAssembly (WASM)
1mo
Save
Mark Applied
Hide
AI Engineer (PPA - 009)
Columbia, Maryland, United States
OnsiteFull Time
15+ YOEActive TS/SCI with polygraph required. 15+ years experience (15 with Master's, 18 with Bachelor's) in CS/Engineering/Data Science/Math; expertise in Python and JavaScript/TypeScript, vector DBs, embeddings, model APIs, model hosting/inference pipelines, secure AI practices, and defense or intelligence support.
Python, JavaScript, TypeScript
4w
Save
Mark Applied
Hide
Agentic AI Engineer
Annapolis Junction, Maryland, United States
$99k-$225k/yr HybridFull Time
5+ YOEDesign and deploy autonomous AI agents, implement agent architectures, integrate tools/APIs, build memory and inference flows; requires 5+ years software experience and TS/SCI clearance with polygraph.
Python, LangGraph, CrewAI, AutoGen, Redis, Postgres, AWS Bedrock AgentCore, Google Gemini Enterprise Agent Platform, Microsoft Foundry Agent Service, Docker, Kubernetes, CI/CD
4w
Save
Mark Applied
Hide
Agentic AI Engineer
Annapolis Junction, Maryland, United States
$99k-$225k/yr OnsiteFull Time
5+ YOE5+ years building software in Python, creating AI agents or multi-step LLM workflows, integrating tools/APIs, building memory systems, handling inference flows and testing; TS/SCI clearance with polygraph and Bachelor’s degree required.
Python, LangGraph, CrewAI, AutoGen, Redis, Postgres, AWS Bedrock AgentCore, Google Gemini Enterprise Agent Platform, Microsoft Foundry Agent Service, Docker, Kubernetes, CI/CD
2mo
Save
Mark Applied
Hide
Director, Machine Learning Engineering
Palo Alto or New York City or Dallas or Bethesda or Seattle
$150k-$300k/yr OnsiteFull Time
10+ YOE10+ years engineering or AI/ML leadership experience; proven track record building scalable distributed systems and personalization platforms; expertise in RAG, context/memory architectures, and real-time inference; strong business acumen and cross-functional leadership.
Retrieval-Augmented Generation (RAG), LLMs
1mo
Save
Mark Applied
Hide
Sr. GenAI Specialist PSA , Solutions Architecture
Herndon, Virginia, United States
$154k-$208k/yr OnsiteFull Time
7+ YOE7+ years designing and operating distributed applications; 5+ years customer-facing experience building production GenAI/ML systems; hands-on LLM, RAG, agentic workflows, prompt engineering, inference optimization; experience with AWS AI/ML services.
Amazon Bedrock, SageMaker, AgentCore, Bedrock Agents, Strands Agents SDK, LangChain, OpenSearch Serverless, pgvector, Pinecone
Explore Jobs
Expand Your Job Search
Top Cities Near Washington for AI Inference Engineer
- AI Inference Engineer jobs in Baltimore, MD
- AI Inference Engineer jobs in Arlington, VA
- AI Inference Engineer jobs in Alexandria, VA
- AI Inference Engineer jobs in Frederick, MD
- AI Inference Engineer jobs in Gaithersburg, MD
- AI Inference Engineer jobs in Rockville, MD
- AI Inference Engineer jobs in Bowie, MD
- AI Inference Engineer jobs in Leesburg, VA
- AI Inference Engineer jobs in Manassas, VA
- AI Inference Engineer jobs in Annapolis, MD
- AI Inference Engineer jobs in College Park, MD
- AI Inference Engineer jobs in Fredericksburg, VA
- AI Inference Engineer jobs in Laurel, MD
- AI Inference Engineer jobs in Herndon, VA
- AI Inference Engineer jobs in Greenbelt, MD
- AI Inference Engineer jobs in Fairfax, VA
- AI Inference Engineer jobs in Westminster, MD
- AI Inference Engineer jobs in Hyattsville, MD
- AI Inference Engineer jobs in Takoma Park, MD
- AI Inference Engineer jobs in Vienna, VA