100 ai infrastructure engineer jobs at 71 companies in Tysons, VA
1mo
Save
Mark Applied
Hide
AI Infrastructure Engineer - Emerging Technologies
Ashburn or Dallas or Columbus
RemoteFull Time
5+ YOEBachelor's in engineering or related field, 5+ years in data center/AI/HPC/power or cooling engineering, strong understanding of AI compute and infrastructure, ability to translate technical analysis into infrastructure strategy, authorized to work in the U.S. (no sponsorship).
NVIDIA GPU architectures, ARM, Battery Energy Storage Systems (BESS), UPS
1mo
Save
Mark Applied
Hide
Staff AI Infrastructure Engineer
Austin or Reston
HybridFull Time
8+ YOE8+ years building distributed systems and cloud-native AI infrastructure; strong Python and systems programming skills; Kubernetes, GPU inference, and platform engineering experience; leadership and architecture experience.
Python, Go, Rust, C++, vLLM, SGLang, TensorRT-LLM, Triton Inference Server, Ray Serve, Kubernetes, Helm, Argo CD, Docker, Prometheus, Grafana, OpenTelemetry, Infrastructure-as-Code, GitOps, CI/CD, AWS, Azure, Oracle Cloud Infrastructure, Google Cloud Platform
2mo
Save
Mark Applied
Hide
AI Infrastructure & Security Engineer
Alexandria, Virginia, United States
$110k-$140k/yr RemoteFull Time
3+ YOE3+ years software engineering and Azure experience, CI/CD and DevOps with Azure DevOps/GitHub, containerization, Python scripting, production AI coding agent experience, security-focused instincts, and ability to communicate across teams.
Claude, Claude Code, CLAUDE.md, Cowork, Azure, Azure Container Apps, Azure DevOps, Azure Repos, GitHub, CI/CD, npm, NuGet, Office 365, eCommerce, CRM, Python, Windows Server, Linux, DNS, TCP/IP, firewalls, VPNs, MCP
2w
Save
Mark Applied
Hide
Principal Platform Engineer, AI & Infrastructure
Denver or Long Beach or Washington
$255k-$375k/yr HybridFull Time
12+ YOE12+ years in software/DevOps/SRE/cloud with deep AI platform and cloud infrastructure expertise; ability to obtain Top-Secret clearance; hands-on with LLM APIs, agent frameworks, and IaC.
CrewAI, Pydantic AI, Terraform, OpenTelemetry, AWS, Azure, GCP
2mo
Save
Mark Applied
Hide
Gen AI Infrastructure Engineer
Woodbridge or New York City or Atlanta or Boston or Chicago or Dallas or Delaware or Denver or Garden City or Cayman Islands or Greenwich or Houston or Los Angeles or Miami or Naples or Nevada or Palm Beach or San Diego or San Francisco or Seattle or Stuart or Washington
$160k-$200k/yr HybridFull Time
7+ YOE7+ years in DevOps/platform/cloud infrastructure engineering; strong AWS (IAM, CloudFormation, Lambda, API Gateway, VPC, CloudWatch, SSM, Secrets Manager, ECR); AWS CDK/CloudFormation/Terraform; CI/CD (Bitbucket/GitHub Actions, OIDC); container and datastore operations; security fundamentals.
AWS Bedrock, AgentCore, Lambda, API Gateway, AWS CDK, CloudFormation, Terraform, Bitbucket Pipelines, GitHub Actions, OIDC, IAM, VPC, CloudWatch, SSM, Secrets Manager, ECR, Neo4j, Neptune, Redis, Milvus, VectorDB
1mo
Save
Mark Applied
Hide
AI Operations & Infrastructure Engineer
Fort Meade, Maryland, United States
OnsiteFull Time
Hands-on experience administering NVIDIA GPU and DPU technologies, AI software stacks, containerization and orchestration (Docker, Kubernetes, Slurm), NVIDIA certifications, and an active TS/SCI clearance with CI Polygraph.
GPUs, DPUs, InfiniBand, Ethernet, Docker, Kubernetes, Slurm, NVIDIA Base Command Manager, Pyxis, Enroot, Run:Ai, NGC CLI, HPL, NCCL, NVIDIA Nemo, ClusterKit, BlueField, MIG, BMC, TPM
2w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
2mo
Save
Mark Applied
Hide
Sr. AI Engineer, Platform Infrastructure, Special Programs
Palo Alto or Washington
$220k-$350k/yr HybridFull Time
5+ YOEBachelor's in CS/engineering; 5+ years Go/Python; 5+ years Kubernetes or similar tooling; ability to obtain Top Secret/SCI clearance.
Go, Python, Kubernetes, Pulumi, Terraform, Linux, CI/CD, Build tooling, NVIDIA CUDA, NVIDIA drivers
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York or San Francisco or McLean or Cambridge or San Jose or Plano
$209k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE +6 years or Master's +4 years; 6+ years programming with Python/Go/Scala/Java; experience deploying scalable AI on cloud; LLM, inference, similarity search, VectorDBs, guardrails, model evaluation, and optimization experience; leadership and research literacy.
Python, Go, Scala, Java, C++, C#, Golang, AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure
2d
Save
Mark Applied
Hide
AI Operations Engineer
Baltimore, Maryland, United States
$140k-$165k/yr OnsiteFull Time
5+ YOE5+ years building and operating CI/CD, platform, developer tooling, or infrastructure systems; production coding experience; pipeline, dependency, progressive delivery, and AI agent operations expertise.
CI/CD, LLM, Jira, Form I-9
1mo
Save
Mark Applied
Hide
Senior AI Architect/Engineer
Arlington or Washington or Pentagon or Springfield or Chantilly or Tysons Corner
$105k-$200k/yr OnsiteFull Time
8+ YOE8+ years in cloud architecture or AI/ML infrastructure, strong Azure experience, knowledge of RAG, embeddings, vector DBs, model APIs, containerized deployments, security and governance for regulated clouds.
Microsoft Azure, Azure GCC High, RAG, embeddings, vector databases, model APIs, containers, APIs
2mo
Save
Mark Applied
Hide
Senior AI ML Engineer - Remote
San Francisco or Minneapolis or Washington, D.C. or United States
$120k-$215k/yr RemoteFull Time
4+ YOE2+ MgmtBachelor's degree or 4+ years equivalent, 4+ years Python, 4+ years cloud infrastructure (AWS/Azure/GCP), 4+ years AI/ML infrastructure experience, 2+ years team lead, 1+ year LLM experience.
Python, AWS, Azure, GCP, Large Language Models (LLMs), GitHub, GitHub Actions, Docker, Terraform, CI/CD
1mo
Save
Mark Applied
Hide
Network Engineer, AI Infrastructure Repair
Sarpy County or Mesa or Aiken or Ashburn or Forest City or Menlo Park or Polk County or Montgomery or Prineville or Fort Worth or Richmond or Chandler or New Albany or Huntsville or Rosemount or Eagle Mountain or Crook County or Houston or United States
$193k-$271k/yr OnsiteFull Time
12+ YOEBachelor's in CS or equivalent, 12+ years network engineering experience at data center/HPC scale, expertise in high-speed fabrics (RDMA, InfiniBand, optical interconnects), program leadership in network fault management and repair automation.
RDMA over Converged Ethernet, InfiniBand, optical interconnects
2w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor’s degree plus 6 years or master’s degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java; cloud AI deployment experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Microsoft Azure, C++, C#, Golang
1w
Save
Mark Applied
Hide
Senior AI Engineer
Tysons, Virginia, United States
RemoteFull Time
Design and implement AWS-based AI infrastructure and services for ML workflows; strong Python and Typescript, AWS (SageMaker, Lambda, Bedrock), ML libraries, GitHub Actions, and observability experience required.
Python, Typescript, GitHub Actions, CDK, SageMaker, Lambda, Bedrock, PyTorch, Pandas, NumPy, GitHub, Amazon EKS, Kubernetes, Datadog
1mo
Save
Mark Applied
Hide
Software Engineer (AI Infrastructure)
Columbia, Maryland, United States
OnsiteFull Time
8+ YOETS/SCI w/Poly clearance, 8+ years experience (or BS+4+), AWS, Kubernetes, Python, observability (OpenTelemetry, Grafana, Prometheus), CI/CD, IaC, systems integration and production-scale infrastructure experience.
AWS, Kubernetes, Python, OpenTelemetry, Grafana, Prometheus, vLLM, LiteLLM, LangChain, Infrastructure-as-Code (IaC), APM, CI/CD, Retrieval Augmented Generation (RAG)
2mo
Save
Mark Applied
Hide
AI Agent & Infrastructure - Lead Engineer
Rockville or Tysons Corner
HybridFull Time
7+ YOE7+ years in software engineering; strong OO design; cloud, DevOps, CI/CD; AI agent, SDLC, observability; Java, Python, JavaScript/TypeScript; AWS; experience with monitoring tools.
Java, Python, JavaScript/TypeScript, Angular, Spring Boot, AWS, Prometheus, Grafana, CloudWatch
1mo
Save
Mark Applied
Hide
Software Engineer (AI Infrastructure)
Columbia, Maryland, United States
OnsiteFull Time
8+ YOE8+ years experience (or Bachelor's +4 years), TS/SCI with polygraph, proven production systems experience, AWS cloud engineering, Kubernetes, Python, observability (OpenTelemetry, Grafana, Prometheus), CI/CD familiarity.
AWS, Kubernetes, Python, OpenTelemetry, Grafana, Prometheus, vLLM, LiteLLM, LangChain, APM
3mo
Save
Mark Applied
Hide
Software Engineer (AI Infrastructure)
Laurel, Maryland, United States
$115k-$160k/yr OnsiteFull Time
8+ YOE8+ years of software development; production systems; cloud AWS; Kubernetes; Python; observability; CI/CD; strong communication.
AWS, Kubernetes, Python, OpenTelemetry, Grafana, Prometheus, CI/CD, Infrastructure as Code
3d
Save
Mark Applied
Hide
AI Cloud Platform Engineer
Washington or United States
$115k-$252k/yr RemoteFull Time
10+ YOERequires U.S. citizenship, ability to obtain DHS EOD Public Trust, degree equivalency, 10+ years of cloud or infrastructure engineering, cloud platform expertise, Terraform, Kubernetes, Docker, CI/CD, and Python.
Terraform, ARM templates, PowerShell, Python, Azure CLI, Logic Apps, Azure Functions, Kubernetes, AKS, EKS, Docker, CI/CD, CSAM, RegScale, eMASS, FedRAMP
Explore Jobs