Description
Are you familiar with Service Meshes, Container Networking, and Ingress Traffic Management? They're the dedicated infrastructure layers that facilitate seamless communication between services and microservices — making it easy to connect, monitor, secure, and control services at scale. Here's your opportunity to be part of the AWS Container Networking offerings that power millions of customer workloads: **ECS Service Connect**, **ECS Service Gateway**, and **AWS Cloud Map**.
Our networking stack is built on three foundational pillars:
- **Envoy Proxy & xDS Control Plane (Service Connect)** — At the core of our service mesh lies Envoy, a versatile, open-source proxy deployed as a sidecar to intercept and manage east-west traffic. Our team builds the Envoy Management Server (xDS) control plane that configures thousands of Envoy proxies in real-time — enabling zero-code load balancing, retries, circuit-breaking, observability, and traffic routing across microservices.
- **Elastic Load Balancing Integration (Service Gateway)** — For north-south ingress traffic, we orchestrate AWS Elastic Load Balancers (ALB & NLB) on behalf of customers. Service Gateway automates the provisioning and lifecycle management of load balancers, listener rules, target groups, TLS certificates, and security groups — abstracting away complex networking infrastructure so customers can expose their ECS services to the internet with a single API call.
- **AWS Cloud Map (Service Discovery)** — The foundational registry that powers service discovery across the stack. Cloud Map provides DNS-based and API-based service registration and resolution, enabling ECS services to find and communicate with each other without hard-coded endpoints. It serves as the backbone for both Service Connect's internal routing and Service Discovery's DNS resolution.
Key job responsibilities
- Design, develop, and operate highly available, scalable distributed systems for container networking and service mesh infrastructure
- Build and extend the Envoy Management Server (xDS) control plane — implementing CDS, EDS, LDS, and RDS APIs that configure thousands of Envoy proxies in real-time for east-west service mesh traffic
- Design and build ELB orchestration systems for Service Gateway — automating ALB/NLB provisioning, listener rule management, target group bindings, TLS certificate association, and multi-service bin-packing to optimize north-south ingress traffic and customer costs
- Develop and scale Cloud Map as the central service registry — building DNS-based and API-based discovery, namespace management, health checking integration, and cross-account service resolution
- Design and implement APIs for ingress traffic management (Service Gateway), service-to-service communication (Service Connect), and service discovery (Cloud Map)
- Drive operational excellence — on-call, COE investigations, deployment safety, and production health
- Build AI-powered operational tooling — develop skills, agents, and automation that improve diagnostics, accelerate root-cause analysis, and enhance operational metrics and alarming
- Design and implement customer self-service capabilities — enabling customers to diagnose, troubleshoot, and resolve networking issues independently through better APIs, dashboards, and guided workflows
- Collaborate with cross-functional teams including Product Managers, partner AWS service teams (ELB, Route 53, ECS Scheduler), and open-source communities
- Influence technical direction through design documents, code reviews, and architectural decisions
A day in the life
Your morning might start with a code review for a teammate's control plane change, followed by a quick check on the deployment pipeline — yesterday's release is baking in gamma and the canary metrics look healthy.
Mid-morning, you dive into a design document for a new feature. You sketch out the system interactions, identify edge cases, and post your proposal for team review.
After lunch, you pair with a teammate to debug a subtle production issue. You trace the request flow end to end, reproduce it locally, and draft a fix.
Later in the afternoon, you work on an AI-powered diagnostic skill you've been building — it correlates metrics, events, and logs to automatically surface root causes for common customer issues. You test it against a recent ticket and it correctly identifies a misconfigured timeout. Before wrapping up, you join a quick sync with a partner team to align on an API contract, then review the on-call dashboard — all green.
Some days you're deep in Envoy internals tracing an HTTP/2 connection pooling issue; other days you're designing a customer-facing API or building automation that makes the next on-call shift smoother. No two days are the same, but the thread that ties them together is making container networking invisible — so customers can focus on their applications, not their infrastructure.
Our networking stack is built on three foundational pillars:
- **Envoy Proxy & xDS Control Plane (Service Connect)** — At the core of our service mesh lies Envoy, a versatile, open-source proxy deployed as a sidecar to intercept and manage east-west traffic. Our team builds the Envoy Management Server (xDS) control plane that configures thousands of Envoy proxies in real-time — enabling zero-code load balancing, retries, circuit-breaking, observability, and traffic routing across microservices.
- **Elastic Load Balancing Integration (Service Gateway)** — For north-south ingress traffic, we orchestrate AWS Elastic Load Balancers (ALB & NLB) on behalf of customers. Service Gateway automates the provisioning and lifecycle management of load balancers, listener rules, target groups, TLS certificates, and security groups — abstracting away complex networking infrastructure so customers can expose their ECS services to the internet with a single API call.
- **AWS Cloud Map (Service Discovery)** — The foundational registry that powers service discovery across the stack. Cloud Map provides DNS-based and API-based service registration and resolution, enabling ECS services to find and communicate with each other without hard-coded endpoints. It serves as the backbone for both Service Connect's internal routing and Service Discovery's DNS resolution.
Key job responsibilities
- Design, develop, and operate highly available, scalable distributed systems for container networking and service mesh infrastructure
- Build and extend the Envoy Management Server (xDS) control plane — implementing CDS, EDS, LDS, and RDS APIs that configure thousands of Envoy proxies in real-time for east-west service mesh traffic
- Design and build ELB orchestration systems for Service Gateway — automating ALB/NLB provisioning, listener rule management, target group bindings, TLS certificate association, and multi-service bin-packing to optimize north-south ingress traffic and customer costs
- Develop and scale Cloud Map as the central service registry — building DNS-based and API-based discovery, namespace management, health checking integration, and cross-account service resolution
- Design and implement APIs for ingress traffic management (Service Gateway), service-to-service communication (Service Connect), and service discovery (Cloud Map)
- Drive operational excellence — on-call, COE investigations, deployment safety, and production health
- Build AI-powered operational tooling — develop skills, agents, and automation that improve diagnostics, accelerate root-cause analysis, and enhance operational metrics and alarming
- Design and implement customer self-service capabilities — enabling customers to diagnose, troubleshoot, and resolve networking issues independently through better APIs, dashboards, and guided workflows
- Collaborate with cross-functional teams including Product Managers, partner AWS service teams (ELB, Route 53, ECS Scheduler), and open-source communities
- Influence technical direction through design documents, code reviews, and architectural decisions
A day in the life
Your morning might start with a code review for a teammate's control plane change, followed by a quick check on the deployment pipeline — yesterday's release is baking in gamma and the canary metrics look healthy.
Mid-morning, you dive into a design document for a new feature. You sketch out the system interactions, identify edge cases, and post your proposal for team review.
After lunch, you pair with a teammate to debug a subtle production issue. You trace the request flow end to end, reproduce it locally, and draft a fix.
Later in the afternoon, you work on an AI-powered diagnostic skill you've been building — it correlates metrics, events, and logs to automatically surface root causes for common customer issues. You test it against a recent ticket and it correctly identifies a misconfigured timeout. Before wrapping up, you join a quick sync with a partner team to align on an API contract, then review the on-call dashboard — all green.
Some days you're deep in Envoy internals tracing an HTTP/2 connection pooling issue; other days you're designing a customer-facing API or building automation that makes the next on-call shift smoother. No two days are the same, but the thread that ties them together is making container networking invisible — so customers can focus on their applications, not their infrastructure.
Basic Qualifications
- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- 1+ years of software development engineer or related occupational experience
- 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
- 1+ years of Object Oriented Design experience
- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
- Experience programming with at least one software programming language
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- 1+ years of software development engineer or related occupational experience
- 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
- 1+ years of Object Oriented Design experience
- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
- Experience programming with at least one software programming language
Preferred Qualifications
- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- Experience with networking fundamentals
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
USA, WA, Seattle - 143,700.00 - 194,400.00 USD annually
- Bachelor's degree in computer science or equivalent
- Experience with networking fundamentals
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, Seattle - 143,700.00 - 194,400.00 USD annually
