27 ml infrastructure engineer jobs at 18 companies in Frederick, MD

PromotedHiringCafe
ML Engineer - Inference & Model Deployment
Cupertino, CA, US
$250k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Turn powerful AI and ML models into fast, reliable production systems. Own inference latency, throughput, model-serving architecture, multi-GPU systems, and production deployment for millions of users.
Python, PyTorch, vLLM, SGLang, TensorRT, LLMs
PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
PromotedHiringCafe
Founding Backend / Infra Engineer
Cupertino, CA, US
$160k-$300k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Own the crawlers, pipelines, and infrastructure powering a real-time job search engine. Strong Node.js and Python fundamentals; bonus points for security and reverse-engineering chops.
Node.js, Python, Elasticsearch, Redis
1mo
Save
Mark Applied
Hide
Senior AI ML Engineer - Remote
San Francisco or Minneapolis or Washington, D.C. or United States
$120k-$215k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
4+ YOE2+ MgmtBachelor's degree or 4+ years equivalent, 4+ years Python, 4+ years cloud infrastructure (AWS/Azure/GCP), 4+ years AI/ML infrastructure experience, 2+ years team lead, 1+ year LLM experience.
Python, AWS, Azure, GCP, Large Language Models (LLMs), GitHub, GitHub Actions, Docker, Terraform, CI/CD
1w
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer
Austin or Reston or United States
HybridFull Time
Seekr
Seekr: Transparent AI platform for enterprise and government decision-making.
5+ YOE5–8 years building distributed systems or cloud/platform services; production Kubernetes and ML infra experience; strong software engineering in Python and Go/Rust/C++; familiarity with GPU inference, model serving frameworks, and cloud platforms.
Kubernetes, Helm, Argo CD, Docker, Prometheus, Grafana, OpenTelemetry, Python, Go, Rust, C++, vLLM, SGLang, TensorRT-LLM, Triton Inference Server, Ray Serve, AWS, Azure, Oracle Cloud Infrastructure, Google Cloud Platform
1w
Save
Mark Applied
Hide
Staff Software Engineer, AI/ML, Google Cloud Security
Reston or New York
$207k-$301k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
8+ YOE3+ MgmtBachelor's or equivalent, 8 years software development, 5 years ML design/infrastructure, 3 years leading technical projects, experience with LLMs/Generative AI and GCP.
Google Cloud Platform (GCP), Vertex AI, TPU
2mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Cambridge or Richmond or McLean or New York or San Jose or San Francisco
$286k-$392k/yr RemoteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
10+ YOE10+ years AI/ML engineering; Python/Go/Scala/Java; distributed compute; CPU/GPU infrastructure; ML/AI workloads.
Python, Go, Scala, Java, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda
1w
Save
Mark Applied
Hide
Senior Systems Engineer
Boonsboro, Maryland, United States
OnsiteFull Time
Changeis
Changeis: Provides systems engineering and infrastructure solutions to ensure resilient, secure, and modern client IT environments.
Design and maintain resilient infrastructure (Linux, Windows, Cisco IOS, cloud), implement HA/DR and failover, lead containerization (Kubernetes/OpenShift/Docker), ensure security compliance and vulnerability remediation, and support DR exercises and system testing.
Linux, Windows, Cisco IOS, cloud, Kubernetes, OpenShift, Docker, CI/CD, RBAC, AI, ML
5d
Save
Mark Applied
Hide
Software Development Engineer - ML Ops (US Federal)
Reston, Virginia, United States
$137k-$205k/yr HybridFull Time
Workday
WorkdayNASDAQ: WDAY: Provides cloud-based software for financial and human capital management.
3+ YOEUS citizen required; 3+ years DevOps experience with infrastructure automation, CI/CD, Python, Kubernetes/Docker; ability to obtain/maintain US security clearance.
Kubernetes, Docker, Python, IAAS, AWS, GCP, ArgoCD, Grafana, Terraform, Git, Jenkins, Service Mesh, Containers, CI/CD
1w
Save
Mark Applied
Hide
Senior AI Architect/Engineer
Arlington or Washington or Pentagon or Springfield or Chantilly or Tysons Corner
$105k-$200k/yr OnsiteFull Time
Technomics
Technomics: Provides cost analysis and decision support services for government.
8+ YOE8+ years in cloud architecture or AI/ML infrastructure, strong Azure experience, knowledge of RAG, embeddings, vector DBs, model APIs, containerized deployments, security and governance for regulated clouds.
Microsoft Azure, Azure GCC High, RAG, embeddings, vector databases, model APIs, containers, APIs
1mo
Save
Mark Applied
Hide
Geospatial Platform Engineer
McLean, Virginia, United States
$137k-$200k/yr OnsiteFull Time
Vantor
Vantor: Providing AI-powered spatial intelligence and high-resolution Earth observation.
8+ YOERequires U.S. citizenship and active TS/SCI with polygraph. Bachelor's in a related field plus ~8+ years experience (or equivalent with advanced degree). Experience with Python/Java/C++/JavaScript/TypeScript/SQL/Bash, Docker, Kubernetes, CI/CD, infrastructure automation, and geospatial/imagery/AI/ML applications.
Python, Java, C++, JavaScript, TypeScript, SQL, Bash, Docker, Kubernetes, Rancher, RKE2, Ansible, Terraform, Packer, Cesium, OMAR, CI/CD, Linux, Apache Airflow, PostgreSQL/PostGIS, Elasticsearch, Trino/Presto, NVIDIA Triton, OpenShift, AWS, Azure, VMware vSphere, HashiCorp Vault, Artifactory, GitOps, Prometheus, Grafana, ELK/OpenSearch, CIS benchmarks, STIGs, ATO processes
3mo
Save
Mark Applied
Hide
Staff Software Engineer
Waltham or North Bethesda
$160k-$180k/yr HybridFull Time
Xometry
XometryNASDAQ: XMTR: Operates an AI-powered marketplace for custom manufacturing and prototyping.
5+ YOE5+ years in software/ML roles; Bachelor’s in CS or related field; strong cloud, IaC, Python; AWS experience; AI/ML infrastructure knowledge.
Terraform, Python, AWS, SageMaker, Kubernetes, Docker, IAM, Lambda, CloudWatch, ECR, EKS, Kinesis
3w
Save
Mark Applied
Hide
Senior Software Engineer
Springfield, Virginia, United States
OnsiteFull Time
Modern Technology Solutions
Modern Technology Solutions: A technology and defense consulting firm providing mission-focused engineering and test and evaluation services.
8+ YOEU.S. citizen with active TS/SCI and ability to pass CI polygraph; 8+ years supporting software engineering or system integration; experience with cloud architectures, virtual infrastructure, CI/CD, DevSecOps, and AI/ML evaluation environments.
AI/ML, cloud-based architectures, virtual infrastructure, APIs, Agile, DevSecOps, CI/CD, containerization technologies, orchestration frameworks, cloud-native development
1mo
Save
Mark Applied
Hide
Cloud Engineer
Rockville, Maryland, United States
$115k-$145k/yr HybridFull Time
Skyward IT Solutions
Skyward IT Solutions: Delivering digital modernization and AI solutions for federal agencies.
3+ YOE3+ years AWS experience, strong security/compliance background (FISMA/Public Trust), automation with Python/Bash, Infrastructure as Code (Terraform/Ansible), cost optimization, and experience hosting AI/ML workloads preferred.
EC2, VPC, IAM, S3, Aurora, Neptune, AWS Well-Architected Framework, SageMaker, Glue, DataBrew, AWS Security Hub, Config, Audit Manager, AWS Trusted Advisor, Terraform, Ansible, Python, Bash, LLMs
6d
Save
Mark Applied
Hide
Senior Lead Software Engineer-AI Foundation Services
Plano or Jersey City or Wilmington or McLean
$171k-$260k/yr OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years software engineering experience building cloud-native AI/ML platform services with Kubernetes, CI/CD, and infrastructure-as-code; proficiency in Python/Java/Go; strong production reliability and secure-by-design practices.
Kubernetes, CI/CD, infrastructure-as-code, Python, Java, Go, GPU
4d
Save
Mark Applied
Hide
Full Stack Developer
Chantilly, Virginia, United States
$150k-$250k/yr OnsiteFull Time
GRVTY
GRVTY: Develops defense technology, cyber, and intelligence software solutions.
Active TS/SCI with polygraph required; experience building scalable backends and user interfaces; familiarity with AI/ML, DevOps, and cloud infrastructure; strong communication and collaboration skills.
AI/ML, Natural Language Processing (NLP), AWS, DevOps
3mo
Save
Mark Applied
Hide
Software Engineer II- (GCC‑High/DoD)- CTJ- Secret
Washington or Reston
$102k-$202k/yr HybridFull Time
Microsoft
MicrosoftNASDAQ: MSFT: Develops software, services, devices, and cloud computing solutions.
3+ YOE3+ years hands-on software design and coding; experience with generative AI/ML, Microsoft Azure, infrastructure-as-code (ARM/Bicep), CI/CD (YAML), Git, Kusto (KQL); ability to obtain/maintain U.S. Government Secret clearance and U.S. citizenship.
C, C++, C#, Java, JavaScript, Python, Git, Microsoft Azure, ARM, Bicep, YAML, CI/CD, Kusto (KQL), EV2, GCC‑High
1mo
Save
Mark Applied
Hide
Senior Principal Architect, AI-Native Platform Transformation
McLean, Virginia, United States
$229k-$360k/yr HybridFull Time
Medallia
Medallia: Provides enterprise experience management and customer feedback software.
10+ YOE10+ years building and operating large-scale distributed systems; hands-on experience with AI/ML infrastructure, agent orchestration, and platform engineering; proven track record migrating legacy architectures and authoring ADRs.
MCP, Architecture Decision Records (ADRs), LLM, LLMOps, AgentOps
2w
Save
Mark Applied
Hide
Founding CTO (New Healthcare Startup)
United States or McLean
$200k-$300k/yr RemoteFull Time
Red Cell Partners
Red Cell Partners: Incubating technology companies in healthcare and national security sectors.
10+ YOE10+ years software engineering experience; strong backend, infrastructure, ETL, cloud (AWS/GCP/Azure), Python/Node.js/Typescript; experience with health data, HL7/FHIR/LOINC, AI/ML, HIPAA, and technical leadership.
Claude, Claude Code, Cursor, GitHub, Python, Node.js, Typescript, AWS, GCP, Azure, EHR, HL7, FHIR, LOINC, Oura, Apple Health, Apple HealthKit, Whoop, Garmin, LLMs
3w
Save
Mark Applied
Hide
AI Solutions Architect - East Region
Hartford or Washington or Tampa or Atlanta or Boston or Charlotte or Trenton or New York or Philadelphia or Pittsburgh
$185k-$235k/yr OnsiteFull Time
World Wide Technology
World Wide Technology: Global technology solutions provider and systems integrator.
10+ YOESenior technical pre-sales architect with 10+ years of experience designing AI/ML infrastructure and platforms, hands-on NVIDIA and cloud experience, strong presentation and whiteboarding skills, and a bachelor’s degree in computer science, engineering, or related field.
NVIDIA DGX, NVIDIA HGX, CUDA, NVIDIA AI Enterprise (NVAIE), NeMo, Omniverse, AWS, Microsoft Azure, GCP, Dell, HPE, Cisco, NetApp, Pure Storage, Vast Data, Advanced Technology Center (ATC), MLOps
1mo
Save
Mark Applied
Hide
Senior Principal Architect, AI-Native Platform Transformation
McLean, Virginia, United States
$229k-$360k/yr HybridFull Time
Medallia
Medallia: Provides cloud-based software for experience management and analytics.
10+ YOE10+ years building and operating large-scale distributed systems; hands-on experience with AI/ML infrastructure, agent orchestration, LLM stacks, ADRs, and leading cross-functional technical initiatives; ability to present to executive stakeholders.
Architecture Decision Records (ADRs), LLM, MCP, A2A, LLMOps, AgentOps
1mo
Save
Mark Applied
Hide
Director, Data Science & AI Engineering
Nashville or Washington D.C. or Los Angeles or San Francisco or New York City
$290k-$440k/yr OnsiteFull Time
Pillsbury Winthrop Shaw Pittman
Pillsbury Winthrop Shaw Pittman: International law firm providing comprehensive legal and strategic advisory.
10+ YOE10+ years data science/AI leadership; production AI/ML, LLMs, RAG, MLOps; strong architecture and governance; strategic and hands-on.
LLMs, RAG, vector databases, embeddings, hybrid search, Model Context Protocol (MCP), prompt engineering, MLOps, LLMOps, CI/CD, cloud infrastructure, data warehouses, BI dashboards