32 ml infrastructure engineer jobs at 23 companies in Rockville, MD
2mo
Save
Mark Applied
Hide
Senior AI ML Engineer - Remote
San Francisco or Minneapolis or Washington, D.C. or United States
$120k-$215k/yr RemoteFull Time
4+ YOE2+ MgmtBachelor's degree or 4+ years equivalent, 4+ years Python, 4+ years cloud infrastructure (AWS/Azure/GCP), 4+ years AI/ML infrastructure experience, 2+ years team lead, 1+ year LLM experience.
Python, AWS, Azure, GCP, Large Language Models (LLMs), GitHub, GitHub Actions, Docker, Terraform, CI/CD
1mo
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer
Austin or Reston or United States
HybridFull Time
5+ YOE5–8 years building distributed systems or cloud/platform services; production Kubernetes and ML infra experience; strong software engineering in Python and Go/Rust/C++; familiarity with GPU inference, model serving frameworks, and cloud platforms.
Kubernetes, Helm, Argo CD, Docker, Prometheus, Grafana, OpenTelemetry, Python, Go, Rust, C++, vLLM, SGLang, TensorRT-LLM, Triton Inference Server, Ray Serve, AWS, Azure, Oracle Cloud Infrastructure, Google Cloud Platform
10h
Save
Mark Applied
Hide
DevOps / ML-Ops Engineer
Arlington, Virginia, United States
HybridFull Time
Authorized U.S. citizen, with hands-on DevOps infrastructure experience across CI/CD, repositories, storage, compute, Linux, containers, networking, hardware provisioning, and scripting with Bash and Python.
AWS, GitLab, MinIO, Nexus, Conan, PyPI, Docker, Slurm, MLflow, Optuna, Prometheus, Grafana, Terraform, Ubuntu, Debian, Linux, BASH, Python, CMake, SSDF, VLAN, FPGA
6d
Save
Mark Applied
Hide
Systems Development Engineer, AI/ML Amazon Dedicated Cloud
Arlington or Herndon
$99k-$160k/yr OnsiteFull Time
1+ YOERequires 1+ year systems engineering, networking, and software development experience; Linux/Unix, infrastructure automation, programming, systems design, and active TS/SCI clearance with polygraph.
Linux, Unix, Python, Ruby, Golang, Java, C++, C#, Rust, CI/CD
2w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
1mo
Save
Mark Applied
Hide
Staff Software Engineer, AI/ML, Google Cloud Security
Reston or New York
$207k-$301k/yr OnsiteFull Time
8+ YOE3+ MgmtBachelor's or equivalent, 8 years software development, 5 years ML design/infrastructure, 3 years leading technical projects, experience with LLMs/Generative AI and GCP.
Google Cloud Platform (GCP), Vertex AI, TPU
3mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Cambridge or Richmond or McLean or New York or San Jose or San Francisco
$286k-$392k/yr RemoteFull Time
10+ YOE10+ years AI/ML engineering; Python/Go/Scala/Java; distributed compute; CPU/GPU infrastructure; ML/AI workloads.
Python, Go, Scala, Java, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda
1mo
Save
Mark Applied
Hide
Software Development Engineer - ML Ops (US Federal)
Reston, Virginia, United States
$137k-$205k/yr HybridFull Time
3+ YOEUS citizenship required; 3+ years DevOps experience, Python proficiency, Kubernetes/Docker experience, infrastructure automation and CI/CD pipeline expertise, ability to obtain federal security clearance.
Kubernetes, Docker, Python, IAAS, AWS, GCP, Containers, Service Mesh, ArgoCD, Grafana, Terraform, Git, Jenkins, CI/CD
1mo
Save
Mark Applied
Hide
Senior AI Architect/Engineer
Arlington or Washington or Pentagon or Springfield or Chantilly or Tysons Corner
$105k-$200k/yr OnsiteFull Time
8+ YOE8+ years in cloud architecture or AI/ML infrastructure, strong Azure experience, knowledge of RAG, embeddings, vector DBs, model APIs, containerized deployments, security and governance for regulated clouds.
Microsoft Azure, Azure GCC High, RAG, embeddings, vector databases, model APIs, containers, APIs
2mo
Save
Mark Applied
Hide
Geospatial Platform Engineer
McLean, Virginia, United States
$137k-$200k/yr OnsiteFull Time
8+ YOERequires U.S. citizenship and active TS/SCI with polygraph. Bachelor's in a related field plus ~8+ years experience (or equivalent with advanced degree). Experience with Python/Java/C++/JavaScript/TypeScript/SQL/Bash, Docker, Kubernetes, CI/CD, infrastructure automation, and geospatial/imagery/AI/ML applications.
Python, Java, C++, JavaScript, TypeScript, SQL, Bash, Docker, Kubernetes, Rancher, RKE2, Ansible, Terraform, Packer, Cesium, OMAR, CI/CD, Linux, Apache Airflow, PostgreSQL/PostGIS, Elasticsearch, Trino/Presto, NVIDIA Triton, OpenShift, AWS, Azure, VMware vSphere, HashiCorp Vault, Artifactory, GitOps, Prometheus, Grafana, ELK/OpenSearch, CIS benchmarks, STIGs, ATO processes
2w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor’s degree plus 6 years or master’s degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java; cloud AI deployment experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Microsoft Azure, C++, C#, Golang
1w
Save
Mark Applied
Hide
Senior AI Engineer
Tysons, Virginia, United States
RemoteFull Time
Design and implement AWS-based AI infrastructure and services for ML workflows; strong Python and Typescript, AWS (SageMaker, Lambda, Bedrock), ML libraries, GitHub Actions, and observability experience required.
Python, Typescript, GitHub Actions, CDK, SageMaker, Lambda, Bedrock, PyTorch, Pandas, NumPy, GitHub, Amazon EKS, Kubernetes, Datadog
1mo
Save
Mark Applied
Hide
Senior Software Engineer
Springfield, Virginia, United States
OnsiteFull Time
8+ YOEU.S. citizen with active TS/SCI and ability to pass CI polygraph; 8+ years supporting software engineering or system integration; experience with cloud architectures, virtual infrastructure, CI/CD, DevSecOps, and AI/ML evaluation environments.
AI/ML, cloud-based architectures, virtual infrastructure, APIs, Agile, DevSecOps, CI/CD, containerization technologies, orchestration frameworks, cloud-native development
1mo
Save
Mark Applied
Hide
Data Engineer
Baltimore, Maryland, United States
FieldFull Time
3+ YOE3+ years designing and operating large-scale hybrid data platforms; expertise with distributed processing, streaming systems, data governance, and building ML-ready data infrastructure.
Databricks, dbt, Docker, Python, SQL, PySpark, Spark, Kafka, AWS, Azure, GCP, CI/CD, infrastructure-as-code
4d
Save
Mark Applied
Hide
Data Engineer - Axion
Sunnyvale or Washington or San Diego or Fort Walton Beach or Ann Arbor or London or Stuttgart or Munich or Stockholm or Bangalore or Seoul or Tokyo
$200k-$275k/yr OnsiteFull Time
5+ YOERequires 5+ years of relevant experience, modern ML infrastructure, large-scale GPU jobs, data software, microservices or databases, U.S. citizenship, and eligibility for security clearance.
React, TypeScript, Python, Golang, Docker, Kubernetes, Opensearch, Postgres, LLMs, VLMs, GPU
2mo
Save
Mark Applied
Hide
Cloud Engineer
Rockville, Maryland, United States
$115k-$145k/yr HybridFull Time
3+ YOE3+ years AWS experience, strong security/compliance background (FISMA/Public Trust), automation with Python/Bash, Infrastructure as Code (Terraform/Ansible), cost optimization, and experience hosting AI/ML workloads preferred.
EC2, VPC, IAM, S3, Aurora, Neptune, AWS Well-Architected Framework, SageMaker, Glue, DataBrew, AWS Security Hub, Config, Audit Manager, AWS Trusted Advisor, Terraform, Ansible, Python, Bash, LLMs
1mo
Save
Mark Applied
Hide
DevOps Engineer
Fort Belvoir, Virginia, United States
$78k-$176k/yr OnsiteFull Time
2+ YOETS/SCI required. Experience automating CI/CD, scripting with Python or Linux Shell, containerization (Kubernetes/Docker), Jenkins, configuration management, AI/ML monitoring, and infrastructure automation. Bachelor's +2 years or 5+ years experience in DevOps.
Python, Linux Shell Script, Kubernetes, Docker, Jenkins, CI/CD, MLflow, AWS, Azure, Google Cloud Platform
1mo
Save
Mark Applied
Hide
Senior Lead Software Engineer-AI Foundation Services
Plano or Jersey City or Wilmington or McLean
$171k-$260k/yr OnsiteFull Time
5+ YOE5+ years software engineering experience building cloud-native AI/ML platform services with Kubernetes, CI/CD, and infrastructure-as-code; proficiency in Python/Java/Go; strong production reliability and secure-by-design practices.
Kubernetes, CI/CD, infrastructure-as-code, Python, Java, Go, GPU
1mo
Save
Mark Applied
Hide
Full Stack Developer
Chantilly, Virginia, United States
$150k-$250k/yr OnsiteFull Time
Active TS/SCI with polygraph required; experience building scalable backends and user interfaces; familiarity with AI/ML, DevOps, and cloud infrastructure; strong communication and collaboration skills.
AI/ML, Natural Language Processing (NLP), AWS, DevOps
2mo
Save
Mark Applied
Hide
Senior Principal Architect, AI-Native Platform Transformation
McLean, Virginia, United States
$229k-$360k/yr HybridFull Time
10+ YOE10+ years building and operating large-scale distributed systems; hands-on experience with AI/ML infrastructure, agent orchestration, and platform engineering; proven track record migrating legacy architectures and authoring ADRs.
MCP, Architecture Decision Records (ADRs), LLM, LLMOps, AgentOps
Explore Jobs
Expand Your Job Search
Top Cities Near Rockville for ML Infrastructure Engineer
- ML Infrastructure Engineer jobs in Washington, DC
- ML Infrastructure Engineer jobs in Baltimore, MD
- ML Infrastructure Engineer jobs in Arlington, VA
- ML Infrastructure Engineer jobs in Alexandria, VA
- ML Infrastructure Engineer jobs in Frederick, MD
- ML Infrastructure Engineer jobs in Gaithersburg, MD
- ML Infrastructure Engineer jobs in Bowie, MD
- ML Infrastructure Engineer jobs in Leesburg, VA
- ML Infrastructure Engineer jobs in Manassas, VA
- ML Infrastructure Engineer jobs in Hagerstown, MD
- ML Infrastructure Engineer jobs in Annapolis, MD
- ML Infrastructure Engineer jobs in College Park, MD
- ML Infrastructure Engineer jobs in Laurel, MD
- ML Infrastructure Engineer jobs in Herndon, VA
- ML Infrastructure Engineer jobs in Greenbelt, MD
- ML Infrastructure Engineer jobs in Fairfax, VA
- ML Infrastructure Engineer jobs in Westminster, MD
- ML Infrastructure Engineer jobs in Hyattsville, MD
- ML Infrastructure Engineer jobs in Takoma Park, MD
- ML Infrastructure Engineer jobs in Vienna, VA