NVIDIA
Posted 2mo ago

Senior Systems Software Engineer - GPU Performance at Scale

NVIDIA
Santa Clara or Texas or North Carolina or United States or California
$184k-$357k/yrHybridFull Time
Responsibilities
  • leading implementation
  • analyzing performance
  • debugging issues
Requirements
  • Expertise in CUDA and systems software
  • Experience with Slurm, Docker, and Linux
  • Strong C/C++/Python/Bash skills
  • Systems architecture and HPC experience
  • BS in relevant field (MS/PhD desirable)
  • 8+ years applicable experience
Technical tools mentioned
CUDASlurmCC++PythonBashDockerLinux

Job description

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

We are looking for a dedicated engineer for the Senior Systems Software Engineer role, focusing on GPU Performance at Scale. At NVIDIA, this role is uniquely positioned to drive innovation in AI and GPU computing. You will contribute to world-class computing hardware and software, fueling groundbreaking advancements in artificial intelligence. You will provide insights on large-scale system composition and tuning mechanisms for high-performance compute runs. Collaborate with researchers, developers, and customers to craft improved workflows and develop new, leading solutions. Engage with HPC, OS, CPU, GPU compute, and systems specialists to architect, build, and optimize large-scale performance platforms.

What you'll be doing:

  • Lead the implementation of performance practices in large-scale GPU infrastructure, delivering powerful tools, methodologies, and flows to validate and improve multiple datacenter products concurrently.

  • Align next-generation AI workloads with next-generation datacenter builds for NVIDIA GPUs, CPUs, and networking hardware. Engage early with HW/FW/SW/platform internal and customer teams.

  • Develop engineering solutions that provide continuous insights into the performance of AI workloads in evolving environments, generating swift insights into improvements and regressions.

  • Decompose high-complexity performance or stability issues into minimal reproduction cases, working towards identifying the root cause.

  • Participate in collaborations with various SW and FW teams (BMC/SBIOS/OS/drivers, etc.) to develop outstanding methods and tools. Analyze, debug, and resolve critical firmware and software issues to achieve the highest AI workload performance at scale.

What we need to see:

  • Proven understanding of accelerated computing software stacks (CUDA).

  • Experience with modern cloud and container-based enterprise computing architectures, with Slurm preferred.

  • Strong programming and scripting experience in C/C++/Python/Bash.

  • Deep expertise in systems architecture and the impact of various components on performance.

  • Experience with container technology and Linux-based OSes, with Docker preferred.

  • Experience supporting high-performance computing or deep learning in engineering or academic research communities.

  • Strong teamwork and communication skills, coupled with results-focused analytical abilities.

  • BS in Engineering, Mathematics, Physics, or Computer Science (or equivalent experience); MS or PhD desirable with 8+ years of applicable experience.

Ways to Stand Out From the Crowd

  • End-to-end GPU performance engineering from the profiler to systems analysis.

  • Linux systems programming and optimization experience.

  • Exposure to virtualization techniques and cloud platform solutions.

  • Experience with scheduling and resource management systems.

  • Experience with large-scale HPC environments.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until June 22, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

About NVIDIA

Designs graphics processing units and artificial intelligence hardware.

Similar jobs

Systems Software Engineer roles near Santa Clara, California
3d
Save
Mark Applied
Hide
Senior Networks Systems Software Engineer
Sunnyvale, California, United States
$137k-$277k/yr HybridFull Time
Hewlett Packard Enterprise
Hewlett Packard EnterpriseNYSE: HPE: Providing global edge-to-cloud infrastructure and IT solutions for businesses.
6+ YOE6+ years as a test engineer, 4+ years with Layer 3 protocols, Python and Robot coding, traffic-generation tools, log troubleshooting, and a bachelor's or master's in electronics or computer science engineering or equivalent experience.
Jira, Python, Robot, Spirent, IXIA, OSPF, ISIS, BGP, MPLS, LDP, RSVP, L3VPN, L2VPN, Segment Routing, VLAN, DHCP, STP, VXLAN, Kubernetes, Microsoft?
4d
Save
Mark Applied
Hide
Systems Software Engineer, Platform Architecture
Cupertino, California, United States
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
Passion for elegant cloud solutions, attention to detail, and collaboration with engineers to build and deploy prototype systems supporting hardware and software architecture.
4d
Save
Mark Applied
Hide
Principal Systems Software Engineer - GPU Platform Systems
Santa Clara or United States
OnsiteFull Time
Oracle
OracleNYSE: ORCL: Provides cloud infrastructure and enterprise software for global businesses.
3+ YOERequires 3–11 years of software development depending on education, 6+ years programming or scripting, systems or firmware experience, hardware integration, Linux/Unix, and complex cross-layer debugging.
C, C++, Python, Bash, SQL, JavaScript, Linux, Unix, BMC, OpenBMC, JTAG, AWS, Azure, Google, Oracle Cloud, ARM, AMD, Intel, NVIDIA, ASIC, FPGA
6d
Save
Mark Applied
Hide
Sr. Systems Software Engineer
Fremont, California, United States
$175k-$195k/yr OnsiteFull Time
SPX Technologies
SPX TechnologiesNYSE: SPXC: Supplies industrial infrastructure for HVAC and measurement markets.
6+ YOERequires 6+ years of product development experience, strong C++ and DSP/RF systems expertise, multithreaded software experience, and strong analytical and communication skills. U.S. citizenship or permanent residence required.
C++, Python, MATLAB, Windows, Linux, Software Defined Radio (SDR), FPGA, CI/CD
1w
Save
Mark Applied
Hide
Principal Systems Software Engineer
San Francisco, California, United States
$260k-$340k/yr OnsiteFull Time
Crusoe
Crusoe: Provides energy-efficient cloud infrastructure powered by stranded and renewable energy.
12+ YOE12+ years designing core infrastructure at hyperscale or in HPC, with Linux kernel, virtualization, high-performance networking, GPU optimization, R&D leadership, and a bachelor's or master's degree in a related field.
Linux kernel, KVM, QEMU, Firecracker, RoCE v2, InfiniBand, RDMA, SR-IOV, Kubernetes, Slurm, NVIDIA, AMD, Linux, IETF RFCs
2w
Save
Mark Applied
Hide
Senior Systems Software Engineer - Infrastructure
Santa Clara, California, United States
$224k-$357k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
12+ YOE12+ years infrastructure/platform/DevOps/SRE experience, strong Python, CI/CD, distributed systems, databases, cloud/on-prem compute, K8s, and experience owning production systems; BS/MS in EE/CS/CE or equivalent.
Python, K8s, SQL
2w
Save
Mark Applied
Hide
Lead or Head of Core, Systems Software Engineer
San Carlos, California, United States
$200k-$350k/yr OnsiteFull Time
1X
1X: Manufacturing safe, general-purpose humanoid robots for home and work.
10+ YOE3+ Mgmt10+ years building complex systems software or embedded/device software; 3+ years leading senior engineers; strong embedded Linux and systems programming in C++; bachelor's degree or equivalent; focus on reliability, scalability, and architecture.
embedded Linux, C++
2w
Save
Mark Applied
Hide
Staff SW Systems Engineer – GovRamp & FedRamp Compliance - 103396
San Jose, California, United States
$170k-$210k/yr HybridFull Time
Extreme Networks
Extreme NetworksNASDAQ: EXTR: Provides cloud-managed networking hardware and software solutions.
8+ YOE8+ years software engineering with 3+ years in security/compliance; experience with security scanning, vulnerability management, GovRamp/FedRamp, CI/CD, container and cloud security; proficiency in Java/Python/Go/C#.
Tenable, Snyk, Sonarqube, Checkmarx, Coverity, Fortify, OWASP ZAP, Burp Suite, Acunetix, Black Duck, WhiteSource, Dependabot, Trivy, Twistlock, Aqua Security, CloudSploit, ScoutSuite, Prowler, Java, Python, Go, C#, JavaScript, Maven, Gradle, npm, pip, cargo, Git, GitHub, GitLab, AWS, Azure, GCP, Docker, Kubernetes, Jenkins, GitLab CI, GitHub Actions, Azure Pipelines, Terraform, CloudFormation, Ansible