NVIDIA
Posted 2mo ago

Senior Software Engineer, Infrastructure Automation and Distributed Systems

NVIDIA
South Carolina or Austin or Westford or Durham or California
$224k-$431k/yrHybridFull Time
Responsibilities
  • designing infrastructure
  • automating systems
  • running services
Requirements
  • BS in CS or related (or equivalent experience)
  • 12+ years experience
  • Infrastructure automation and distributed systems experience
  • Proficiency with Python/Go/Perl/Ruby
  • Strong Linux/Networking/Storage/Containers knowledge
  • On-call participation
Technical tools mentioned
PythonGoPerlRubyLinuxKubernetesOpenStackDockerSlurmNVIDIA Collective Communication Library (NCCL)EDAMCP serversbare metal as a service (BMaaS)

Job description

We are seeking Systems Engineers and Software Engineers interested in building and running reliable large scale infrastructure platform services. In this organization, you will ensure that our internal and external facing EDA services atop of NVIDIA hardware are running as reliably as needed. NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hard-working people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you.

What you’ll be doing:

  • Design, build, deploy, and run infrastructure services & manage the software life cycle in scope to meet our business goals.

  • Participate in the definition of our internal facing service level objectives and error budgets as part of our overall observability strategy.

  • Eliminate toil or automate it where the ROI of building and maintaining automation is worth it.

  • Practice sustainable blameless incident prevention and incident response while being a member of an oncall rotation.

  • Consult with and provide consultation for peer teams on systems design best practices.

What we need to see:

  • BS degree in Computer Science or a related technical field involving coding (e.g., physics or mathematics) or equivalent experience.

  • 12+ years of relevant experience.

  • A track record showing a good balance between initiating your own projects, convincing others to collaborate with you and collaborating well on projects initiated by others.

  • Experience with infrastructure automation and distributed systems design developing tools for running large scale private or public cloud system in production.

  • Experience in one or more of the following: Python, Go, Perl or Ruby.

  • In depth knowledge in one or more of Linux, Networking, Storage, and Containers.

Ways to stand out from the crowd:

  • Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive. Experience accelerating positive impact to the business using coding assistant(s), MCP servers, or AI agents.

  • Experience working with or developing bare metal as a service (BMaaS) associated systems.

  • Experience working with or developing multi-cloud infrastructure services and running private or public cloud systems based on one or more of Kubernetes, OpenStack, Docker or Slurm.

  • Experience teaching reliability (e.g SRE) or more general cloud systems good practices to peers or to other companies (e.g CRE).

  • Background with NVIDIA Collective Communication Library (NCCL).

No prior experience having worked in a team of any particular name or having worked in a ML/AI focused team are required but also a nice to have.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 224,000 USD - 356,500 USD for Level 5, and 272,000 USD - 431,250 USD for Level 6.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 4, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

About NVIDIA

Designs graphics processing units and artificial intelligence hardware.

Similar jobs

Software Engineer roles near Austin, Texas
15h
Save
Mark Applied
Hide
Staff Software Engineer
Austin, Texas, United States
OnsiteFull Time
Level
Level: Building interactive learning platforms to improve student academic outcomes.
10+ YOE10+ years of professional software engineering experience, including 2+ years in game development; proficiency in C++ or C#, game engine experience, Git, debugging, performance optimization, and cross-functional collaboration.
C++, C#, Unity, Unreal, Godot, Git, Python, GDScript, Lua
18h
Save
Mark Applied
Hide
Software Engineer, Cash Line
United States or Canada or San Carlos or Columbus or Austin or San Francisco or New York City
$142k-$197k/yr RemoteFull Time
Upstart
UpstartNasdaq: UPST: AI-powered lending marketplace for consumer and automotive loans.
4+ YOEBachelor's degree in computer science, engineering, or related field or equivalent experience; 4+ years of software engineering experience; backend services, APIs, distributed systems, and tested maintainable code.
Python, Java, Kotlin, Ruby, Node.js, REST, GraphQL, CI/CD, A/B testing
19h
Save
Mark Applied
Hide
Staff Software Engineer, Fullstack-MarTech
New York City or San Francisco or United States or Los Angeles or Seattle or Austin or Washington, D.C. or Philadelphia or San Diego or Chicago or Atlanta or Salt Lake City or Australia or Canada or South America
$170k-$250k/yr HybridFull Time
Flex
Flex: A financial platform allowing renters to split monthly rent payments.
8+ YOERequires 8+ years software development, 6+ years Java, 3+ years TypeScript and React, plus AWS, scalable APIs, event-driven systems, web performance, and cross-functional communication experience.
Java, Spring Boot, TypeScript, React, AWS, Spring, Gradle, JUnit, JVM, EKS, Aurora RDS, ElastiCache, DynamoDB, REST APIs, Braze, Singular, AppsFlyer, Branch, Google Tag Manager, Amplitude, LaunchDarkly, Meta, Google, TikTok, Apple, Snowflake, GitHub Actions, git, DataDog, CDK, Terraform, React Native
22h
Save
Mark Applied
Hide
Staff Software Engineer
Toronto or New York City or Austin or Berlin or Bucharest or Chicago or Dubai or Jakarta or London or Paris or San Francisco or São Paulo or Singapore or Seoul or Sydney or Tokyo
$184k-$314k/yr HybridFull Time
Braze
BrazeNASDAQ: BRZE: Platform for personalized customer engagement and cross-channel messaging.
7+ YOERequires 7+ years of relevant experience, full-stack development, strong TypeScript and React skills, scalable web architecture expertise, mentoring experience, and clear technical communication. Python or Ruby on Rails preferred.
TypeScript, React, Vue, Python, Ruby on Rails, LLM, AI coding agents
1d
Save
Mark Applied
Hide
Confluent - Senior Software Engineer - Backend
Poughkeepsie or Lowell or Rochester or Tucson or Research Triangle Park or Armonk or Boston or Bellevue or Atlanta or San Jose or Dallas or Austin or San Francisco or Seattle
$111k-$207k/yr RemoteFull Time
IBM
IBMNew York Stock Exchange: IBM: Global technology providing enterprise software, cloud, and consulting.
2+ YOERequires a bachelor's degree and 2–5 years building distributed backend systems, proficiency in Go, Java, or C++, cloud and Kubernetes experience, and knowledge of networking, operating systems, and storage.
Go, Java, C++, Kubernetes
1d
Save
Mark Applied
Hide
Staff Software Engineer
Austin or Atlanta
$186k-$280k/yr HybridFull Time
Commerce
CommerceNasdaq: CMRC: Provides an AI-driven ecosystem for global e-commerce businesses.
10+ YOE10+ years of software engineering experience, bachelor's degree or equivalent, backend expertise in 2+ server-side languages, distributed systems architecture, cloud, microservices, data storage, observability, technical leadership, and mentorship.
PHP, Go, Scala, Java, Python, Ruby, AWS, GCP, SQL, Sentry, Kibana, Datadog
1d
Save
Mark Applied
Hide
Sr Software Engineer
Austin, Texas, United States
$172k-$222k/yr HybridFull Time
PayPal
PayPalNASDAQ: PYPL: Global digital payments platform for consumers and merchants.
3+ YOEMaster’s degree plus 3 years, or bachelor’s degree plus 5 years, in a related field. Requires Jenkins, Docker, Kubernetes, IaC, AWS, Linux, programming, and relational database experience.
Jenkins, Docker, Kubernetes, Terraform, Ansible, AWS, Linux, Python, Go, Bash, Postgres, Oracle, Infrastructure as Code (IaC), CI/CD, EKS, ECS, Lambda, IAM, SSL, AWS Key Management Service (KMS)
1d
Save
Mark Applied
Hide
Software Engineer
Austin, Texas, United States
$103k-$178k/yr HybridFull Time
Thales
ThalesEuronext Paris: HO: Designs and manufactures electronic systems for aerospace and defense.
1+ YOEBachelor’s degree with 1–4+ years or master’s degree with 0–2+ years in a relevant field. Requires C/C++ and Go, Linux kernel development, debugging, distributed systems, Kubernetes, and Agile experience.
C, C++, Go, Windows, Linux, FUSE, Docker, Kubernetes, AWS, Azure, Confluence, SAFe Agile