Amazon
Posted 4w ago

Software Development Engineer I – AI/ML Network Infrastructure, Annapurna Labs

Amazon
Cupertino, California, United States
$127k-$185k/yrOnsiteFull Time
Responsibilities
  • writing code
  • maintaining infrastructure
  • developing automation
Requirements
  • Bachelor's or Master's in CS/CE
  • Strong C/C++ and Linux proficiency
  • Knowledge of OS
  • Parallel architecture and distributed systems
  • Experience with performance profiling and GPU or RDMA concepts
Technical tools mentioned
CC++PythonAWSCI/CDGrafanaAthenaNCCLNVSHMEMNIXLCUDALinux

Job description

Description

We're looking for a talented early-career engineer to join our team that owns the network stack for EC2 distributed AI/ML systems. You'll work on software that enables the world's largest AI models to train across massive GPU clusters, developing support for communication libraries and frameworks like NCCL, NVSHMEM, and NIXL.

This is a ground-floor opportunity to work at the intersection of high-performance computing, networking, and machine learning infrastructure - building the systems that power the largest AI workloads in the cloud.

Key job responsibilities
- Write high-performance C/C++ code for network communication libraries running on custom AWS hardware
- Build and maintain infrastructure that monitors functionality and performance of large-scale AI/ML workloads
- Develop automation using Python and AWS tools (CI/CD, Grafana, Athena) to test, benchmark, and deliver software to customers
- Design mechanisms to detect functional and performance regressions before they reach production
- Work across many instance types, software stacks, and Linux environments

Basic Qualifications

- Bachelor's or Master's degree in Computer Science, Computer Engineering, or related field (recent graduates welcome)
- Strong proficiency in C/C++
- Solid coursework or project experience in: 1/ Operating Systems (Linux internals, kernel concepts, memory management) 2/ Parallel Computer Architecture (multi-threading, SIMD, GPU programming, cache coherence) 3/ Distributed Systems (consensus, message passing, fault tolerance, scalability)
- Familiarity with Linux development environments and toolchains

Preferred Qualifications

- Internship experience in ML communications, HPC networking, or RDMA/high-speed interconnects
- Exposure to network programming (sockets, MPI, collective communication patterns)
- Experience with performance profiling and optimization
- Familiarity with GPU programming (CUDA) or hardware-software co-design
- Contributions to open-source projects in systems, networking, or HPC

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.



USA, CA, Cupertino - 127,100.00 - 185,000.00 USD annually

About Amazon

Global online retail and cloud computing technology provider.

Similar jobs

Software Development Engineer roles near Cupertino, California
1d
Save
Mark Applied
Hide
Staff Software Development Engineer - Rust, Compilers, and GPU Systems
San Jose, California, United States
$210k-$360k/yr HybridFull Time
AMD
AMDNASDAQ: AMD: Designs and manufactures computer processors and graphics technology.
Deep production Rust experience with compiler or systems programming; familiarity with GPU architecture, compiler frameworks, low-level software, validation, and formal methods. Technical leadership and a relevant degree or equivalent experience preferred.
Rust, rustc, MLIR, LLVM, MIR, AMDGPU, C, C++, GCC, ELF, DWARF, LLVM MC, GCN, RDNA, CDNA, ROCm, HIP, HSA, Verus, Lean, Coq, Isabelle, Dafny, TLA+
2d
Save
Mark Applied
Hide
Senior Software Development Engineer 5
San Jose, California, United States
$159k-$302k/yr OnsiteFull Time
Adobe
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
10+ YOERequires 10+ years of software development experience, a related bachelor's or advanced degree or equivalent, Java/Scala, databases, distributed systems, cloud services, and collaboration skills.
Generative AI, Agentic AI, Spark, Kafka, Java, Scala, SQL, NoSQL, MySQL, MongoDB, Redis, JavaScript, ReactJS, AngularJS, Docker, Kubernetes, AWS, Splunk, PHP, LLMs
6d
Save
Mark Applied
Hide
Software Development Engineer Graduate (Intent-Based Networking) - 2027 Start
San Jose, California, United States
OnsiteFull Time
ByteDance
ByteDance: Developing AI-driven content platforms and mobile applications.
Bachelor's or master's degree in a related technical discipline; networking knowledge; front-end technologies; one back-end language; SQL and NoSQL database skills; strong coding and design practices.
Software Defined Networking (SDN), HTML, CSS, JavaScript, TypeScript, Python, Go, C, C++, Rust, SQL, NoSQL, Robotron, Apstra, Forward Networks, TCP/IP, DNS, ARP
1w
Save
Mark Applied
Hide
Software Development Engineer Graduate (TikTok - Testing - Growth) - 2027 Start
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$128k-$256k/yr OnsiteFull Time
TikTok
TikTok: Global short-form video hosting and social media platform.
Bachelor's or master's degree in a relevant computing field, programming skills in Java, Python, Objective-C, or Golang, testing fundamentals, and knowledge of algorithms and system architecture.
Java, Python, Objective-C, Golang, API, Docker, K8s, Kafka, Redis, Django, Flask
1w
Save
Mark Applied
Hide
Software Development Engineer - Equipment Control
Sunnyvale, California, United States
$160k-$271k/yr OnsiteFull Time
Intuitive
IntuitiveNASDAQ: ISRG: Robotic-assisted systems for minimally invasive surgery.
3+ YOEBachelor's degree plus 5 years or master's plus 3 years in engineering, with software design and development experience. Requires programming, software architecture, hardware integration, systems design, and technical leadership skills.
C#, Python, Programmable Logic Controllers (PLCs), Modbus, OPC, EtherNet/IP, Software Development Life Cycle (SDLC)
1w
Save
Mark Applied
Hide
Sr Software Development Eng
Saint Paul or San Francisco
$122k-$184k/yr OnsiteFull Time
NextEra Energy
NextEra EnergyNYSE: NEE: Generates, transmits, and distributes electricity from diverse energy sources.
7+ YOEBachelor's degree or equivalent experience and 7+ years of experience. Requires software development, system architecture, testing, technical documentation, and component design experience.
CI/CD, SDLC
1w
Save
Mark Applied
Hide
Sr Software Development Engineer (Full Stack) - Evisort AI
Pleasanton, California, United States
$176k-$264k/yr HybridFull Time
Workday
WorkdayNASDAQ: WDAY: Provides cloud-based software for financial and human capital management.
8+ YOERequires 8+ years of software engineering, 5+ years with web frameworks and relational databases, plus cloud SaaS, distributed systems, DevOps, containers, and cross-functional collaboration experience.
Python, Flask, Django, FastAPI, PostgreSQL, AWS, DevOps, CI/CD, Docker, Kubernetes, Elasticsearch, Java, TypeScript
1w
Save
Mark Applied
Hide
Senior Software Development Engineer, SDN Routing and Dynamic Networks
Washington or Cupertino or California
$249k-$348k/yr OnsiteFull Time
Blue Origin: Develops reusable rockets and systems for human spaceflight.
5+ YOEBachelor’s degree in a related STEM field, 5+ years of software development experience, networking or distributed systems expertise, IP routing knowledge, and production experience with C++, Rust, Go, Java, or Python.
C++, Rust, Go, Java, Python, IP, SDN, IS-IS, BGP, MPLS, Segment Routing, PCEP, TI-LFA, ECMP, Defense Biometric Identification System (DBIDS), Commercial Motor Vehicles, Gross Vehicle Weight (GVW), Gross Vehicle Weight Rating (GVWR), CDL, Merchant Mariner Credential, DOT