HiringCafe
Join our community

25 llmops engineer jobs at 14 companies in Frederick, MD

3w
Save
Mark Applied
Hide
LLMOps Engineer
McLean, Virginia, United States
OnsiteFull Time
Steampunk
Steampunk: Design-led federal technology consulting and innovation services firm.
2+ YOEAbility to hold a public trust; degree in CS/data engineering/ML or related; 2+ years in software/DevOps/MLOps or 3–5+ years depending on degree; Python, Docker, Kubernetes, cloud (AWS/Azure/GCP), LLM tooling experience.
Python, Hugging Face Transformers, LangChain, LlamaIndex, Docker, Kubernetes, AWS, Azure, GCP, CI/CD, vector databases
Job PostingView all
3w
Save
Mark Applied
Hide
LLMOps Engineer
McLean, Virginia, United States
$115k-$145k/yr OnsiteFull Time
Steampunk
Steampunk: Federal digital transformation and consulting services provider.
2+ YOEAbility to hold Public Trust. Degree in CS/Data/ML (BS or MS) plus multi-year experience; Python, LLM tool familiarity (Hugging Face Transformers, LangChain, LlamaIndex), Docker/Kubernetes, cloud (AWS/Azure/GCP), CI/CD, and MLOps/DevSecOps experience.
Python, Hugging Face Transformers, LangChain, LlamaIndex, Docker, Kubernetes, AWS, Azure, GCP, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
AI Engineer
Arlington, Virginia, United States
$117k-$243k/yr OnsiteFull Time
Accenture Federal Services
Accenture Federal ServicesNYSE: ACN: Provides technology and consulting services to U.S. federal agencies.
Experience in AI/ML production engineering, LLMOps or MLOps, deployment of RAG architectures; Kubernetes-based deployments; Python development; GPU inference optimization; familiarity with LangGraph, Semantic Kernel, vLLM, Ollama, Ray; NVIDIA GPU ecosystems.
LLMOps, MLOps, Kubernetes, Python, LangGraph, Semantic Kernel, vLLM, Ollama, Ray, OpenAI API, GPU NVIDIA, Vector databases
Job PostingView all
1mo
Save
Mark Applied
Hide
AI Engineer
Washington, District of Columbia, United States
$142k-$236k/yr OnsiteFull Time
ManTech
ManTech: Provides technology solutions for defense and intelligence agencies.
7+ YOE7+ years AI/ML production engineering experience, strong Python, TensorFlow/PyTorch, MLOps/LLMOps, Kubernetes with GPU optimization, Azure ecosystem experience, and ability to obtain TS/SCI with polygraph.
Python, TensorFlow, PyTorch, Kubernetes, MLOps, LLMOps, OpenAI-compatible APIs, LangGraph, Semantic Kernel, Ray, NVIDIA GPU, Azure OpenAI, Azure Synapse, Databricks, Azure Security Center
Job PostingView all
3w
Save
Mark Applied
Hide
Senior. Distinguished AI Engineer (Agentic AI Platform)
San Francisco or McLean or Cambridge or San Jose or New York
$343k-$392k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
8+ YOEMaster's + 8 years or Bachelor's + 10 years in AI/ML; deep software engineering skills; experience with agentic frameworks, LLMOps, cloud platforms, Kubernetes, and mentoring/architecting large-scale AI systems.
Python, Go, Golang, Scala, Java, C++, C#, LangGraph, AutoGen, Semantic Kernel (Microsoft), Semantic Kernel, LangChain, CrewAI, LlamaIndex, LLMOps, Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning, AWS, Google Cloud, Azure, K8s, Helm, CRDs, CLI, SDK, VectorDBs
Job PostingView all
2d
Save
Mark Applied
Hide
AI Engineer - Top Secret
Alexandria, Virginia, United States
$131k-$237k/yr OnsiteFull Time
Sunayu
Sunayu: Engineering technology and DevSecOps solutions for defense and intelligence missions.
12+ YOE12+ years in data science/analytics with AI/ML production engineering, active Top Secret clearance with TS/SCI eligibility and polygraph, experience with MLOps, Kubernetes, Python, and deploying AI systems.
LLMOps, MLOps, RAG architectures, Kubernetes, OpenAI-compatible APIs, Python, LangGraph, Semantic Kernel, vLLM, Ollama, Ray, NVIDIA, Vector databases, Azure/C2S
Job PostingView all
3d
Save
Mark Applied
Hide
AI/ML Delivery Engineer
Bethesda or United States
$164k-$207k/yr RemoteFull Time
GDIT
GDITNYSE: GD: Delivers IT and mission services to government agencies.
10+ YOE10+ years experience designing and delivering enterprise AI/ML solutions, MS in CS/STEM or equivalent, strong cloud, MLOps/LLMOps, security and governance experience; must be US Person and obtain Tier 3 Public Trust.
CI/CD, MLOps, LLMOps, ModelOps, large language models (LLM)
Job PostingView all
1mo
Save
Mark Applied
Hide
GenAI Engineer
Mexico or Brazil or Peru or Chile or Washington
HybridContract
NTT DATA
NTT DATA: Global IT services and digital business transformation solutions
Design, build, deploy, and operate scalable GenAI and ML solutions using Azure AI stack and modern GenAI frameworks; implement MLOps/LLMOps, RAG, vector search, and responsible AI practices.
Azure AI Foundry, Azure OpenAI, Azure Machine Learning, Azure AI Search, Cognitive Services, LangChain, LangGraph, Semantic Kernel, Azure DevOps, Git, Databricks
Job PostingView all
2w
Save
Mark Applied
Hide
Machine Learning Engineer/AI Engineer
United States or Raleigh or Durham or Cary or Washington
$97k-$130k/yr RemoteFull Time
Acentra Health
Acentra Health: Provides technology and clinical services for government healthcare agencies.
4+ YOEBachelor's in CS/Data Science (Master/PhD preferred), 4+ years ML/AI engineering experience with applied LLM/AI deployments, Python and ML frameworks (TensorFlow, PyTorch, Hugging Face, scikit-learn), LLMs, embeddings, vector DBs, RAG, AWS/Azure, MLOps/CI/CD, healthcare/regulatory experience, mentoring and strong communication.
Python, TensorFlow, PyTorch, Hugging Face, scikit-learn, LLMs, RAG, embeddings, vector DBs, Pinecone, Weaviate, FAISS, AWS, Azure, MLOps, LLMOps, CI/CD, LangChain, LlamaIndex, AutoGen, CrewAI, Semantic Kernel, HL7, FHIR, HIPAA, NLP
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Agentic AI/ML Engineer
Arlington or Crystal City
$200k-$270k/yr OnsiteFull Time
General Dynamics Information TechnologyNYSE: GD: Provides mission-critical IT services to government and defense organizations.
10+ YOECurrent TS/SCI required (must be able to obtain TS/SCI + polygraph), US citizenship, 10+ years related experience, Bachelor’s in CS/Software Engineering or equivalent, Python and AI/ML experience, CI/CD, MLOps, Docker, Git, and familiarity with LLM/agentic AI concepts.
Python, CI/CD, Docker, Git, PyTorch, TensorFlow, scikit-learn, LangChain, LangGraph, MCP, Google ADK, A2A, RESTful APIs, PostgreSQL, Kubernetes, MLOps, LLMOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Principal Architect, AI-Native Platform Transformation
McLean, Virginia, United States
$229k-$360k/yr HybridFull Time
Medallia
Medallia: Provides enterprise experience management and customer feedback software.
10+ YOE10+ years building and operating large-scale distributed systems; hands-on experience with AI/ML infrastructure, agent orchestration, and platform engineering; proven track record migrating legacy architectures and authoring ADRs.
MCP, Architecture Decision Records (ADRs), LLM, LLMOps, AgentOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Principal Architect, AI-Native Platform Transformation
McLean, Virginia, United States
$229k-$360k/yr HybridFull Time
Medallia
Medallia: Provides cloud-based software for experience management and analytics.
10+ YOE10+ years building and operating large-scale distributed systems; hands-on experience with AI/ML infrastructure, agent orchestration, LLM stacks, ADRs, and leading cross-functional technical initiatives; ability to present to executive stakeholders.
Architecture Decision Records (ADRs), LLM, MCP, A2A, LLMOps, AgentOps
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Director, Software Engineering
McLean, Virginia, United States
$228k-$342k/yr OnsiteFull Time
Freddie Mac
Freddie MacOTCQB: FMCC: Purchases and securitizes home mortgages for the secondary market.
12+ YOE5+ Mgmt12+ years software engineering experience with 5+ years leading teams; Bachelor\u0002s in CS/Engineering or equivalent; production GenAI/AI/ML delivery, cloud-native, secure development, hands-on coding, stakeholder management.
RAG, LLM, vector databases, enterprise search, APIs, microservices, containers, CI/CD, IaC, MLOps, LLMOps, vector stores
Job PostingView all
1mo
Save
Mark Applied
Hide
Director, Data Engineering & AI
Chicago or Dallas or Los Angeles or Minneapolis or New York or San Francisco or Seattle or Washington, D.C.
$200k-$250k/yr HybridFull Time
West Monroe
West Monroe: Business and technology consultancy specializing in digital transformation.
10+ YOE10+ years in client-facing consulting; deep data platform expertise (Databricks, GCP, Snowflake); AI data engineering and scalable data architectures; travel 30-50%; hybrid work arrangement.
Databricks, GCP, Snowflake, AWS, Azure, MLOps, LLMOps
Job PostingView all
1w
Save
Mark Applied
Hide
Applied AI Scientist
Washington, D.C., District of Columbia, United States
OnsiteFull Time
World Bank Group
World Bank Group: Global partnership providing financing and knowledge to developing countries
5+ YOEMaster's in CS/Data Science/Software Engineering with 5+ years' experience; expertise in Python, SQL, modern AI/ML (foundation models, multimodal, RL, causal ML, time-series, geospatial), cloud and MLOps, production ML systems, and team leadership; willing to travel.
Python, SQL, PyTorch, TensorFlow, JAX, Hugging Face, LangGraph, LangChain, Ray, vLLM, Docker, Kubernetes, Azure, AWS, Google Cloud, CI/CD, MLOps, LLMOps, GPU, Retrieval-Augmented Generation (RAG)
Job PostingView all
3mo
Save
Mark Applied
Hide
Manager, Solutions Architecture - Data Center Specialists
Santa Clara or Washington or North Carolina
$224k-$357k/yr HybridFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
8+ YOE4+ MgmtBS/MS/PhD or equivalent experience in related engineering fields; 8+ years software/work or research experience with Python/C++; 4+ years leading teams; experience with large-scale AI/HPC training, data center infrastructure, microservices and partner/customer engagement.
Python, C++, NeMo Framework, DeepSpeed, Slurm, Docker, Kubernetes, Singularity, MPI, MLOps, LLMOps, Ansible, Terraform, InfiniBand
Job PostingView all
1mo
Save
Mark Applied
Hide
Director, Data Science & AI Engineering
Nashville or Washington D.C. or Los Angeles or San Francisco or New York City
$290k-$440k/yr OnsiteFull Time
Pillsbury Winthrop Shaw Pittman
Pillsbury Winthrop Shaw Pittman: International law firm providing comprehensive legal and strategic advisory.
10+ YOE10+ years data science/AI leadership; production AI/ML, LLMs, RAG, MLOps; strong architecture and governance; strategic and hands-on.
LLMs, RAG, vector databases, embeddings, hybrid search, Model Context Protocol (MCP), prompt engineering, MLOps, LLMOps, CI/CD, cloud infrastructure, data warehouses, BI dashboards
Job PostingView all

Explore Jobs

Expand Your Job Search