27 ml infrastructure engineer jobs at 18 companies in Frederick, MD
🚀PromotedHiringCafe
ML Engineer - Inference & Model Deployment
Cupertino, CA, US
$250k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Turn powerful AI and ML models into fast, reliable production systems. Own inference latency, throughput, model-serving architecture, multi-GPU systems, and production deployment for millions of users.
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Own the crawlers, pipelines, and infrastructure powering a real-time job search engine. Strong Node.js and Python fundamentals; bonus points for security and reverse-engineering chops.
San Francisco or Minneapolis or Washington, D.C. or United States
$120k-$215k/yrRemoteFull Time
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
4+ YOE2+ MgmtBachelor's degree or 4+ years equivalent, 4+ years Python, 4+ years cloud infrastructure (AWS/Azure/GCP), 4+ years AI/ML infrastructure experience, 2+ years team lead, 1+ year LLM experience.
Python, AWS, Azure, GCP, Large Language Models (LLMs), GitHub, GitHub Actions, Docker, Terraform, CI/CD
Seekr: Transparent AI platform for enterprise and government decision-making.
5+ YOE5–8 years building distributed systems or cloud/platform services; production Kubernetes and ML infra experience; strong software engineering in Python and Go/Rust/C++; familiarity with GPU inference, model serving frameworks, and cloud platforms.
8+ YOE3+ MgmtBachelor's or equivalent, 8 years software development, 5 years ML design/infrastructure, 3 years leading technical projects, experience with LLMs/Generative AI and GCP.
Changeis: Provides systems engineering and infrastructure solutions to ensure resilient, secure, and modern client IT environments.
Design and maintain resilient infrastructure (Linux, Windows, Cisco IOS, cloud), implement HA/DR and failover, lead containerization (Kubernetes/OpenShift/Docker), ensure security compliance and vulnerability remediation, and support DR exercises and system testing.
Software Development Engineer - ML Ops (US Federal)
Reston, Virginia, United States
$137k-$205k/yrHybridFull Time
WorkdayNASDAQ: WDAY: Provides cloud-based software for financial and human capital management.
3+ YOEUS citizen required; 3+ years DevOps experience with infrastructure automation, CI/CD, Python, Kubernetes/Docker; ability to obtain/maintain US security clearance.
Arlington or Washington or Pentagon or Springfield or Chantilly or Tysons Corner
$105k-$200k/yrOnsiteFull Time
Technomics: Provides cost analysis and decision support services for government.
8+ YOE8+ years in cloud architecture or AI/ML infrastructure, strong Azure experience, knowledge of RAG, embeddings, vector DBs, model APIs, containerized deployments, security and governance for regulated clouds.
Microsoft Azure, Azure GCC High, RAG, embeddings, vector databases, model APIs, containers, APIs
Vantor: Providing AI-powered spatial intelligence and high-resolution Earth observation.
8+ YOERequires U.S. citizenship and active TS/SCI with polygraph. Bachelor's in a related field plus ~8+ years experience (or equivalent with advanced degree). Experience with Python/Java/C++/JavaScript/TypeScript/SQL/Bash, Docker, Kubernetes, CI/CD, infrastructure automation, and geospatial/imagery/AI/ML applications.
Modern Technology Solutions: A technology and defense consulting firm providing mission-focused engineering and test and evaluation services.
8+ YOEU.S. citizen with active TS/SCI and ability to pass CI polygraph; 8+ years supporting software engineering or system integration; experience with cloud architectures, virtual infrastructure, CI/CD, DevSecOps, and AI/ML evaluation environments.
Senior Lead Software Engineer-AI Foundation Services
Plano or Jersey City or Wilmington or McLean
$171k-$260k/yrOnsiteFull Time
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years software engineering experience building cloud-native AI/ML platform services with Kubernetes, CI/CD, and infrastructure-as-code; proficiency in Python/Java/Go; strong production reliability and secure-by-design practices.
GRVTY: Develops defense technology, cyber, and intelligence software solutions.
Active TS/SCI with polygraph required; experience building scalable backends and user interfaces; familiarity with AI/ML, DevOps, and cloud infrastructure; strong communication and collaboration skills.
AI/ML, Natural Language Processing (NLP), AWS, DevOps
MicrosoftNASDAQ: MSFT: Develops software, services, devices, and cloud computing solutions.
3+ YOE3+ years hands-on software design and coding; experience with generative AI/ML, Microsoft Azure, infrastructure-as-code (ARM/Bicep), CI/CD (YAML), Git, Kusto (KQL); ability to obtain/maintain U.S. Government Secret clearance and U.S. citizenship.
Senior Principal Architect, AI-Native Platform Transformation
McLean, Virginia, United States
$229k-$360k/yrHybridFull Time
Medallia: Provides enterprise experience management and customer feedback software.
10+ YOE10+ years building and operating large-scale distributed systems; hands-on experience with AI/ML infrastructure, agent orchestration, and platform engineering; proven track record migrating legacy architectures and authoring ADRs.
MCP, Architecture Decision Records (ADRs), LLM, LLMOps, AgentOps
Hartford or Washington or Tampa or Atlanta or Boston or Charlotte or Trenton or New York or Philadelphia or Pittsburgh
$185k-$235k/yrOnsiteFull Time
World Wide Technology: Global technology solutions provider and systems integrator.
10+ YOESenior technical pre-sales architect with 10+ years of experience designing AI/ML infrastructure and platforms, hands-on NVIDIA and cloud experience, strong presentation and whiteboarding skills, and a bachelor’s degree in computer science, engineering, or related field.
NVIDIA DGX, NVIDIA HGX, CUDA, NVIDIA AI Enterprise (NVAIE), NeMo, Omniverse, AWS, Microsoft Azure, GCP, Dell, HPE, Cisco, NetApp, Pure Storage, Vast Data, Advanced Technology Center (ATC), MLOps
Senior Principal Architect, AI-Native Platform Transformation
McLean, Virginia, United States
$229k-$360k/yrHybridFull Time
Medallia: Provides cloud-based software for experience management and analytics.
10+ YOE10+ years building and operating large-scale distributed systems; hands-on experience with AI/ML infrastructure, agent orchestration, LLM stacks, ADRs, and leading cross-functional technical initiatives; ability to present to executive stakeholders.
Architecture Decision Records (ADRs), LLM, MCP, A2A, LLMOps, AgentOps