31 ai ml infrastructure engineer jobs at 23 companies in Rosedale, MD
1w
Save
Mark Applied
Hide
Staff AI Infrastructure Engineer -
Costa Mesa or Seattle or Washington or Boston
$220k-$292k/yr OnsiteFull Time
7+ YOERequires 7+ years building production-scale ML systems, proficiency in Python, Go, or C++, distributed systems expertise, Docker/Kubernetes, distributed training, data pipelines, technical leadership, and Top Secret clearance eligibility.
MLOps, Python, Go, C++, Docker, Kubernetes, PyTorch Distributed, Ray, Slurm, Megatron-LM, AWS Trainium, Google TPUs, RLHF/DPO, CI/CD
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
1mo
Save
Mark Applied
Hide
Senior AI Architect/Engineer
Arlington or Washington or Pentagon or Springfield or Chantilly or Tysons Corner
$105k-$200k/yr OnsiteFull Time
8+ YOE8+ years in cloud architecture or AI/ML infrastructure, strong Azure experience, knowledge of RAG, embeddings, vector DBs, model APIs, containerized deployments, security and governance for regulated clouds.
Microsoft Azure, Azure GCC High, RAG, embeddings, vector databases, model APIs, containers, APIs
3w
Save
Mark Applied
Hide
Senior AI Engineer
Tysons, Virginia, United States
RemoteFull Time
Design and implement AWS-based AI infrastructure and services for ML workflows; strong Python and Typescript, AWS (SageMaker, Lambda, Bedrock), ML libraries, GitHub Actions, and observability experience required.
Python, Typescript, GitHub Actions, CDK, SageMaker, Lambda, Bedrock, PyTorch, Pandas, NumPy, GitHub, Amazon EKS, Kubernetes, Datadog
1w
Save
Mark Applied
Hide
Principal, AI Engineer
Arlington, Virginia, United States
$190k-$238k/yr OnsiteFull Time
10+ YOERequires 10+ years in software, data, or machine learning engineering; bachelor's degree; production AI/ML expertise; advanced LLM experience; Python proficiency; cloud and GPU infrastructure experience; and technical leadership.
Python, Databricks, LangGraph, CrewAI, DevOps, MLOps, LLMOps
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor’s degree plus 6 years or master’s degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java; cloud AI deployment experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Microsoft Azure, C++, C#, Golang
3mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Cambridge or Richmond or McLean or New York or San Jose or San Francisco
$286k-$392k/yr RemoteFull Time
10+ YOE10+ years AI/ML engineering; Python/Go/Scala/Java; distributed compute; CPU/GPU infrastructure; ML/AI workloads.
Python, Go, Scala, Java, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda
2w
Save
Mark Applied
Hide
Systems Development Engineer, AI/ML Amazon Dedicated Cloud
Arlington or Herndon
$99k-$160k/yr OnsiteFull Time
1+ YOERequires 1+ year systems engineering, networking, and software development experience; Linux/Unix, infrastructure automation, programming, systems design, and active TS/SCI clearance with polygraph.
Linux, Unix, Python, Ruby, Golang, Java, C++, C#, Rust, CI/CD
1w
Save
Mark Applied
Hide
Senior Machine Learning Engineer, AI Evaluation
Alexandria, Virginia, United States
$100k-$130k/yr HybridFull Time
7+ YOEBachelor's degree or equivalent experience and 7+ years in ML/LLM engineering, applied AI, data science, or research infrastructure. Requires Python, production systems, AI evaluation, cloud infrastructure, and reproducibility expertise.
Python, BigQuery, Vertex AI, IAM, Looker, Looker Studio, Google Cloud Platform
2mo
Save
Mark Applied
Hide
AI Solutions Architect - East Region
Hartford or Washington or Tampa or Atlanta or Boston or Charlotte or Trenton or New York or Philadelphia or Pittsburgh
$185k-$235k/yr OnsiteFull Time
10+ YOESenior technical pre-sales architect with 10+ years of experience designing AI/ML infrastructure and platforms, hands-on NVIDIA and cloud experience, strong presentation and whiteboarding skills, and a bachelor’s degree in computer science, engineering, or related field.
NVIDIA DGX, NVIDIA HGX, CUDA, NVIDIA AI Enterprise (NVAIE), NeMo, Omniverse, AWS, Microsoft Azure, GCP, Dell, HPE, Cisco, NetApp, Pure Storage, Vast Data, Advanced Technology Center (ATC), MLOps
1d
Save
Mark Applied
Hide
Customer Engineer, AI Infrastructure, Google Public Sector
Reston or Washington, D.C.
$152k-$221k/yr OnsiteFull Time
Bachelor's degree or equivalent, 10 years of cloud-native architecture experience in customer-facing or support roles, ML model development and deployment experience, and active US Top Secret/SCI clearance with polygraph.
Keras, PyTorch, TensorFlow, JAX, Slurm, vLLM, Ray, Vertex, K8s, GPU, TPU, Google Cloud
1mo
Save
Mark Applied
Hide
Senior Lead Software Engineer-AI Foundation Services
Plano or Jersey City or Wilmington or McLean
$171k-$260k/yr OnsiteFull Time
5+ YOE5+ years software engineering experience building cloud-native AI/ML platform services with Kubernetes, CI/CD, and infrastructure-as-code; proficiency in Python/Java/Go; strong production reliability and secure-by-design practices.
Kubernetes, CI/CD, infrastructure-as-code, Python, Java, Go, GPU
3mo
Save
Mark Applied
Hide
Director, Data Science & AI Engineering
Nashville or Washington D.C. or Los Angeles or San Francisco or New York City
$290k-$440k/yr OnsiteFull Time
10+ YOE10+ years data science/AI leadership; production AI/ML, LLMs, RAG, MLOps; strong architecture and governance; strategic and hands-on.
LLMs, RAG, vector databases, embeddings, hybrid search, Model Context Protocol (MCP), prompt engineering, MLOps, LLMOps, CI/CD, cloud infrastructure, data warehouses, BI dashboards
1w
Save
Mark Applied
Hide
Senior Applications Engineer (DLA)
Fort Belvoir or Dayton or Washington
HybridFull Time
10+ YOEBachelor’s degree in a technical discipline and 10+ years’ experience in applications or software engineering; AWS, AI/ML, cloud-native architectures, DevSecOps, CI/CD, infrastructure as code, and DoD IL5 experience required.
AWS, AWS GovCloud, AI/ML, CI/CD, infrastructure as code, Risk Management Framework (RMF), Authority to Operate (ATO), STIGs, Section 508, CAC, PKI
2mo
Save
Mark Applied
Hide
Geospatial Platform Engineer
McLean, Virginia, United States
$137k-$200k/yr OnsiteFull Time
8+ YOERequires U.S. citizenship and active TS/SCI with polygraph. Bachelor's in a related field plus ~8+ years experience (or equivalent with advanced degree). Experience with Python/Java/C++/JavaScript/TypeScript/SQL/Bash, Docker, Kubernetes, CI/CD, infrastructure automation, and geospatial/imagery/AI/ML applications.
Python, Java, C++, JavaScript, TypeScript, SQL, Bash, Docker, Kubernetes, Rancher, RKE2, Ansible, Terraform, Packer, Cesium, OMAR, CI/CD, Linux, Apache Airflow, PostgreSQL/PostGIS, Elasticsearch, Trino/Presto, NVIDIA Triton, OpenShift, AWS, Azure, VMware vSphere, HashiCorp Vault, Artifactory, GitOps, Prometheus, Grafana, ELK/OpenSearch, CIS benchmarks, STIGs, ATO processes
1d
Save
Mark Applied
Hide
DevSecOps Engineer - Contract
United States or Baltimore
$80-$88/hr RemoteContract
3+ YOERequires 3+ years in DevSecOps, platform, SRE, or cloud infrastructure engineering; AWS AI/ML production experience; Python, SQL, IaC, CI/CD, Docker, orchestration, security, and data pipeline expertise.
Amazon Web Services (AWS), Amazon Bedrock, SageMaker, Infrastructure as Code, CI/CD, Docker, ECS, EKS, Python, SQL, S3, Glue, Lambda, Step Functions
2mo
Save
Mark Applied
Hide
Senior Principal Architect, AI-Native Platform Transformation
McLean, Virginia, United States
$229k-$360k/yr HybridFull Time
10+ YOE10+ years building and operating large-scale distributed systems; hands-on experience with AI/ML infrastructure, agent orchestration, and platform engineering; proven track record migrating legacy architectures and authoring ADRs.
MCP, Architecture Decision Records (ADRs), LLM, LLMOps, AgentOps
12h
Save
Mark Applied
Hide
Software Development Engineer
United States or Alaska or Mississippi or North Dakota or Virginia or California or Seattle or New York City or Hawaii or Illinois or Massachusetts or New Hampshire or Oregon or Washington or Texas or Washington or Santa Clara or San Francisco or Los Angeles or Kirkland
$86k-$167k/yr RemoteFull Time
2+ YOERequires 2+ years of software engineering experience and 2+ years with Python, JavaScript, React, and Node.js, plus scalable applications, DevOps, CI/CD, AI/ML infrastructure, and production systems experience.
JavaScript, Python, React, Node.js, GitHub Actions, Docker, AWS, Webpack, Artifactory, OpenAI, Anthropic, Google, AWS ECS, GitHub, LLMs, RAG
2d
Save
Mark Applied
Hide
Systems Engineer
Fort Meade, Maryland, United States
$87k-$198k/yr HybridFull Time
5+ YOE5+ years supporting enterprise infrastructure in federal or mission-critical environments; Linux, cloud, virtualization, cybersecurity, classified networks, and systems engineering experience required. Secret clearance and high school diploma or GED required.
Linux, Red Hat Enterprise Linux (RHEL), CentOS, AWS, Ansible, Bash, Git, Jenkins, Nutanix, VMware vSphere, STIGs, LDAP, Docker, RMF, ATO, CI/CD, DevOps, Cisco, Juniper, Artificial Intelligence (AI), Machine Learning (ML)
4d
Save
Mark Applied
Hide
Principal Software Engineer - PA172
Bethesda or San Francisco or Waltham or Colorado
$164k-$257k/yr RemoteFull Time
8+ YOERequires 8+ years of backend, data, or infrastructure engineering experience; proficiency in Java, Go, or Python; SQL and large-scale data modeling; and experience with distributed systems, big data, or applied AI/ML.
Java, Go, Python, SQL, LangGraph, MCP, Kafka, Kinesis, ClickHouse, DynamoDB, Bigtable, Memcached, Firehose, Airflow, Snowflake, Microsoft Copilot, Cursor, ChatGPT, Claude