96 ai infrastructure engineer jobs at 63 companies in Middle River, MD
2mo
Save
Mark Applied
Hide
AI Infrastructure & Security Engineer
Alexandria, Virginia, United States
$110k-$140k/yr RemoteFull Time
3+ YOE3+ years software engineering and Azure experience, CI/CD and DevOps with Azure DevOps/GitHub, containerization, Python scripting, production AI coding agent experience, security-focused instincts, and ability to communicate across teams.
Claude, Claude Code, CLAUDE.md, Cowork, Azure, Azure Container Apps, Azure DevOps, Azure Repos, GitHub, CI/CD, npm, NuGet, Office 365, eCommerce, CRM, Python, Windows Server, Linux, DNS, TCP/IP, firewalls, VPNs, MCP
2mo
Save
Mark Applied
Hide
Gen AI Infrastructure Engineer
Woodbridge or New York City or Atlanta or Boston or Chicago or Dallas or Delaware or Denver or Garden City or Cayman Islands or Greenwich or Houston or Los Angeles or Miami or Naples or Nevada or Palm Beach or San Diego or San Francisco or Seattle or Stuart or Washington
$160k-$200k/yr HybridFull Time
7+ YOE7+ years in DevOps/platform/cloud infrastructure engineering; strong AWS (IAM, CloudFormation, Lambda, API Gateway, VPC, CloudWatch, SSM, Secrets Manager, ECR); AWS CDK/CloudFormation/Terraform; CI/CD (Bitbucket/GitHub Actions, OIDC); container and datastore operations; security fundamentals.
AWS Bedrock, AgentCore, Lambda, API Gateway, AWS CDK, CloudFormation, Terraform, Bitbucket Pipelines, GitHub Actions, OIDC, IAM, VPC, CloudWatch, SSM, Secrets Manager, ECR, Neo4j, Neptune, Redis, Milvus, VectorDB
1w
Save
Mark Applied
Hide
AI & HPC Infrastructure Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irvine or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$266k/yr HybridFull Time
5+ YOERequires 5+ years designing AI infrastructure, accelerated computing, clusters, orchestration, and automation; bachelor's degree or equivalent experience. Strong Kubernetes, Python, Terraform, and cloud expertise required.
Slurm, Run:ai, Kubernetes, NVIDIA Base Command Manager (BCM), NVIDIA NGC, NCCL, NVLink, CUDA, TensorRT-LLM, vLLM, SGLang, Triton Inference Server, NVIDIA Dynamo, llm-d, MLPerf, NCCL tests, fio, iperf, InfiniBand, Ethernet, SONiC, NVMe, NVMe-oF, VAST, Weka, DDN, AWS, Azure, GCP, VMware, Nutanix, Python, Terraform, Ansible, REST, OpenAPI, JSON, YAML, TensorFlow, PyTorch, JAX, Jupyter notebooks, Google Colab, MCP
2mo
Save
Mark Applied
Hide
AI Operations & Infrastructure Engineer
Fort Meade, Maryland, United States
OnsiteFull Time
Hands-on experience administering NVIDIA GPU and DPU technologies, AI software stacks, containerization and orchestration (Docker, Kubernetes, Slurm), NVIDIA certifications, and an active TS/SCI clearance with CI Polygraph.
GPUs, DPUs, InfiniBand, Ethernet, Docker, Kubernetes, Slurm, NVIDIA Base Command Manager, Pyxis, Enroot, Run:Ai, NGC CLI, HPL, NCCL, NVIDIA Nemo, ClusterKit, BlueField, MIG, BMC, TPM
4d
Save
Mark Applied
Hide
Staff AI Infrastructure Engineer -
Costa Mesa or Seattle or Washington or Boston
$220k-$292k/yr OnsiteFull Time
7+ YOERequires 7+ years building production-scale ML systems, proficiency in Python, Go, or C++, distributed systems expertise, Docker/Kubernetes, distributed training, data pipelines, technical leadership, and Top Secret clearance eligibility.
MLOps, Python, Go, C++, Docker, Kubernetes, PyTorch Distributed, Ray, Slurm, Megatron-LM, AWS Trainium, Google TPUs, RLHF/DPO, CI/CD
3d
Save
Mark Applied
Hide
AI Engineer
Minneapolis or Minnesota or Denver or Chicago or Seattle or Portland or Washington
$85k-$128k/yr HybridFull Time
3+ YOEAssociate degree or equivalent experience; 3+ years in platform engineering, DevOps, or AI/ML infrastructure; experience with Azure, Docker, Kubernetes, CI/CD, MLOps, and distributed systems.
Microsoft Azure, Docker, Kubernetes, Microsoft Fabric, CI/CD
3w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
3mo
Save
Mark Applied
Hide
Sr. AI Engineer, Platform Infrastructure, Special Programs
Palo Alto or Washington
$220k-$350k/yr HybridFull Time
5+ YOEBachelor's in CS/engineering; 5+ years Go/Python; 5+ years Kubernetes or similar tooling; ability to obtain Top Secret/SCI clearance.
Go, Python, Kubernetes, Pulumi, Terraform, Linux, CI/CD, Build tooling, NVIDIA CUDA, NVIDIA drivers
2mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York or San Francisco or McLean or Cambridge or San Jose or Plano
$209k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE +6 years or Master's +4 years; 6+ years programming with Python/Go/Scala/Java; experience deploying scalable AI on cloud; LLM, inference, similarity search, VectorDBs, guardrails, model evaluation, and optimization experience; leadership and research literacy.
Python, Go, Scala, Java, C++, C#, Golang, AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure
1w
Save
Mark Applied
Hide
AI Operations Engineer
Baltimore, Maryland, United States
$140k-$165k/yr OnsiteFull Time
5+ YOE5+ years building and operating CI/CD, platform, developer tooling, or infrastructure systems; production coding experience; pipeline, dependency, progressive delivery, and AI agent operations expertise.
CI/CD, LLM, Jira, Form I-9
1mo
Save
Mark Applied
Hide
Senior AI Architect/Engineer
Arlington or Washington or Pentagon or Springfield or Chantilly or Tysons Corner
$105k-$200k/yr OnsiteFull Time
8+ YOE8+ years in cloud architecture or AI/ML infrastructure, strong Azure experience, knowledge of RAG, embeddings, vector DBs, model APIs, containerized deployments, security and governance for regulated clouds.
Microsoft Azure, Azure GCC High, RAG, embeddings, vector databases, model APIs, containers, APIs
6d
Save
Mark Applied
Hide
AI Engineer- Manager- Commercial Technology & Innovation
New York City or Tampa or Atlanta or Chicago or Washington
$99k-$232k/yr OnsiteFull Time
5+ YOEBachelor's degree and 5+ years of experience required. Proficiency in AI implementation, Python, C++, machine learning libraries, data integration, infrastructure, neural networks, and reinforcement learning.
Python, C++, TensorFlow, Scikit-Learn, AWS, Google Cloud, Microsoft Azure, Databricks, Snowflake
2mo
Save
Mark Applied
Hide
Senior AI ML Engineer - Remote
San Francisco or Minneapolis or Washington, D.C. or United States
$120k-$215k/yr RemoteFull Time
4+ YOE2+ MgmtBachelor's degree or 4+ years equivalent, 4+ years Python, 4+ years cloud infrastructure (AWS/Azure/GCP), 4+ years AI/ML infrastructure experience, 2+ years team lead, 1+ year LLM experience.
Python, AWS, Azure, GCP, Large Language Models (LLMs), GitHub, GitHub Actions, Docker, Terraform, CI/CD
5d
Save
Mark Applied
Hide
Principal, AI Engineer
Arlington, Virginia, United States
$190k-$238k/yr OnsiteFull Time
10+ YOERequires 10+ years in software, data, or machine learning engineering; bachelor's degree; production AI/ML expertise; advanced LLM experience; Python proficiency; cloud and GPU infrastructure experience; and technical leadership.
Python, Databricks, LangGraph, CrewAI, DevOps, MLOps, LLMOps
3w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor’s degree plus 6 years or master’s degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java; cloud AI deployment experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Microsoft Azure, C++, C#, Golang
2w
Save
Mark Applied
Hide
Senior AI Engineer
Tysons, Virginia, United States
RemoteFull Time
Design and implement AWS-based AI infrastructure and services for ML workflows; strong Python and Typescript, AWS (SageMaker, Lambda, Bedrock), ML libraries, GitHub Actions, and observability experience required.
Python, Typescript, GitHub Actions, CDK, SageMaker, Lambda, Bedrock, PyTorch, Pandas, NumPy, GitHub, Amazon EKS, Kubernetes, Datadog
1mo
Save
Mark Applied
Hide
Software Engineer (AI Infrastructure)
Columbia, Maryland, United States
OnsiteFull Time
8+ YOETS/SCI w/Poly clearance, 8+ years experience (or BS+4+), AWS, Kubernetes, Python, observability (OpenTelemetry, Grafana, Prometheus), CI/CD, IaC, systems integration and production-scale infrastructure experience.
AWS, Kubernetes, Python, OpenTelemetry, Grafana, Prometheus, vLLM, LiteLLM, LangChain, Infrastructure-as-Code (IaC), APM, CI/CD, Retrieval Augmented Generation (RAG)
2mo
Save
Mark Applied
Hide
AI Agent & Infrastructure - Lead Engineer
Rockville or Tysons Corner
HybridFull Time
7+ YOE7+ years in software engineering; strong OO design; cloud, DevOps, CI/CD; AI agent, SDLC, observability; Java, Python, JavaScript/TypeScript; AWS; experience with monitoring tools.
Java, Python, JavaScript/TypeScript, Angular, Spring Boot, AWS, Prometheus, Grafana, CloudWatch
1mo
Save
Mark Applied
Hide
Software Engineer (AI Infrastructure)
Columbia, Maryland, United States
OnsiteFull Time
8+ YOE8+ years experience (or Bachelor's +4 years), TS/SCI with polygraph, proven production systems experience, AWS cloud engineering, Kubernetes, Python, observability (OpenTelemetry, Grafana, Prometheus), CI/CD familiarity.
AWS, Kubernetes, Python, OpenTelemetry, Grafana, Prometheus, vLLM, LiteLLM, LangChain, APM
3mo
Save
Mark Applied
Hide
Software Engineer (AI Infrastructure)
Laurel, Maryland, United States
$115k-$160k/yr OnsiteFull Time
8+ YOE8+ years of software development; production systems; cloud AWS; Kubernetes; Python; observability; CI/CD; strong communication.
AWS, Kubernetes, Python, OpenTelemetry, Grafana, Prometheus, CI/CD, Infrastructure as Code
Explore Jobs