NVIDIA
Posted 5mo ago

Senior System Software Engineer - Data Platform Observability

NVIDIA
Santa Clara or Austin or United States
$184k-$288k/yrHybridFull Time
Responsibilities
  • designing ingestion
  • implementing governance
  • developing interfaces
Requirements
  • BS/MS in CS/EE or equivalent
  • 8+ years full-stack development for data platforms/infrastructure
  • Proficiency with backend and frontend languages
  • Observability tools
  • IaC on Kubernetes, and familiarity with streaming and storage
Technical tools mentioned
PythonJSJavaRustGoReactApache SparkElastic/Open SearchGrafanaPrometheusELK stackKubernetesHelmTerraformAnsibleOpenTelemetry (OTEL)Vector

Job description

NVIDIA’s Hardware Infrastructure organization is seeking a Senior System Software Engineer to lead the evolution of our next-generation Data & Observability Platform. We serve and collaborate directly with NVIDIA’s rapidly growing AI, HW, and SW engineering and research teams across the company. We are looking for a Full-Stack technical lead who is not afraid to dig deep into infrastructure. You will be the technical anchor for our Observability stack, driving the transition to a modern tooling that is best fit for our customers and use cases. You will build the centralized platform that thousands of NVIDIA engineers rely on to visualize chip telemetry, debug distributed pipelines, and ensure platform reliability.

What you’ll be doing:

  • Architect High-Performance Ingestion: Design and build centralized telemetry pipelines capable of handling massive scale. You will solve global latency challenges by implementing modern, push-based edge collection architectures to replace legacy proxy models.

  • Build Policy Enforcement Systems: Design and implement the technical infrastructure for data governance,  policy engines, access control enforcement points,  secure credential management, and audit logging. Looking for someone who has built governance controls into a platform, not just administered them.

  • Focus on User Experience: Develop a modern, web interface and APIs  that unify distinct observability signals into a seamless, consolidated user experience.

  • Optimize Storage & Cost: Implement cost-effective tiered storage architectures. You will define strategies for routing high-volume data to cold storage solutions to reduce costs while maintaining multi-year data retention.

  • Drive Platform Automation: Architect workflow orchestration systems to automate platform maintenance, data lifecycle management, and complex pipeline operations.

  • Work in a diverse team to provide operational and strategic data to empower our engineers and researchers to improve performance, productivity, and efficiency to continuously improve quality, workloads, and processes through better observability.

What we need to see:

  • BS or MS in Computer Science, Electrical Engineering, or related field (or equivalent experience).

  • 8+ years of full-stack software development experience with a focus on Data Platforms or Infrastructure Tools.

  • Strong Full-Stack Fluency: Proficiency in high-performance backend systems programming and modern frontend web frameworks for building responsive user interfaces (Python, JS, Java, Rust, Go, React, or similar).

  • Observability Expertise: Experience with observability platforms such as Apache Spark, Elastic/Open Search, Grafana, Prometheus, and other similar open-source tools. Hands-on experience operating and extending the Grafana Ecosystem or ELK stack at scale. You understand the internals of time-series databases and inverted indexes.

  • Infrastructure-as-Code: Experience deploying complex stateful services on Kubernetes using Helm, Terraform, or Ansible.

  • Streaming & Storage: Familiarity with event streaming and modern data lake formats 

Ways to stand out from the crowd:

  • Experience writing Custom Grafana data source Plugins or backend plugins in Go.

  • Background with migrating legacy monoliths to microservices or Vector-based pipelines.

  • Experience with OpenTelemetry (OTEL) collector configuration, writing custom processors, or instrumentation SDKs.

  • Background in Data Governance, including implementation of Policy-as-Code or compliance frameworks in a regulated environment.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until March 1, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

About NVIDIA

Designs GPU-accelerated computing and artificial intelligence hardware.

Similar jobs

System Software Engineer roles near Santa Clara, California
1w
Save
Mark Applied
Hide
Senior/Staff System Software Engineer — ADAS Vision Platform
Mountain View, California, United States
OnsiteFull Time
Phantom AI
Phantom AI: Develops computer vision and sensor fusion software for vehicles.
6+ YOE6+ years in real-time or embedded system software; expert C++ and solid C; OS and architecture expertise; ROS/ROS2, serialization, middleware, and TCP/UDP/Ethernet; BS/MS in Computer Science or equivalent.
Linux, QNX, INTEGRITY, C++, C, ROS, ROS2, Protocol Buffers, DDS, ZeroMQ, TCP, UDP, Ethernet, RT Linux, rosbag, rosbag2, MCAP, TensorRT, TIDL, CUDA, CAN, SOME/IP
1w
Save
Mark Applied
Hide
Staff System Software Engineer, AOSP (Android OS), IOT
San Francisco, California, United States
$185k-$273k/yr HybridFull Time
Motive
Motive: Provides an AI-powered fleet management and physical operations platform.
8+ YOE8+ years of software development experience; bachelor's degree or equivalent experience; Kotlin, Java, C++, AOSP, Android OS, Linux, embedded programming, and RTOS experience required.
Kotlin, Java, C++, AOSP (Android Open Source Project), Android OS, Linux, RTOS
1w
Save
Mark Applied
Hide
System Software Engineer
San Jose, California, United States
$144k-$230k/yr OnsiteFull Time
Broadcom
BroadcomNASDAQ: AVGO: Designs and sells semiconductors and infrastructure software to enterprises.
12+ YOEBS/MS in computer science, electronics and communications, or equivalent; 12+ years of experience; expertise in RDMA, Linux kernel networking, drivers, firmware, C/C++, Python, and performance tuning.
RDMA, QoS, Linux, Linux kernel, Linux Network Drivers, Linux Kernel Networking, Virtual Switching, C, C++, Python, x86, ARM64
3w
Save
Mark Applied
Hide
System Software Engineer - HP IQ
San Francisco, California, United States
$162k-$288k/yr OnsiteFull Time
HP
HPNYSE: HPQ: Manufactures personal computers, printers, and 3D printing hardware.
8+ YOE8+ years system software and embedded platform experience; strong C or C++; driver and low-level framework development; Python; hardware-software debugging; performance and power optimization.
C, C++, Python, Android, Linux, Windows, Perfmon, Valgrind, GPU, DSP, logic analyzers, ARM System-on-Chip (SOC)
3w
Save
Mark Applied
Hide
System Software Engineer - HP IQ
San Francisco, California, United States
$162k-$288k/yr OnsiteFull Time
HP
HPNYSE: HPQ: Produces personal computers, printers, and related digital imaging products.
8+ YOE8+ years system software/embedded platform experience; strong C or C++ skills; Python experience; systems design, low-level driver and firmware development, debugging at HW/SW interface; ARM SoC familiarity.
C, C++, Python, Perfmon, Valgrind, Android, Linux, Windows, ARM, GPU, DSP, logic analyzer
4w
Save
Mark Applied
Hide
Windows System Software Engineer
Sunnyvale, California, United States
$150k-$250k/yr OnsiteFull Time
Cylake
Cylake: Developing an AI-native cybersecurity platform for sovereign environments.
Extensive experience with Windows kernel internals, kernel driver development, C/C++ programming, debugging multithreaded systems, and Windows internals analysis.
WinDbg, C, C++, Rust, WDM, WDF, Windows Filtering Platform (WFP), NDIS, ETW
1mo
Save
Mark Applied
Hide
System Software Engineer, Networking
Sunnyvale, California, United States
OnsiteFull Time
Tensordyne
Tensordyne: Designs AI chips and systems for efficient model inference.
Experience designing and operating data-center/HPC networks, deep familiarity with L2/L3, ECMP, BGP, RoCE, QoS, PFC, buffer tuning and telemetry; systems-level software skills across userspace, Linux kernel, drivers and firmware; strong programming in C/C++, Python, Go, or Rust; BS/MS in EE/CS or equivalent experience.
SONiC, FBOSS, Cumulus Linux, SAI, C, C++, Python, Go, Rust, Linux, OpenConfig gNMI, YANG
1mo
Save
Mark Applied
Hide
System Software Engineer — Node & Cluster Management
Mountain View, California, United States
$120k-$475k/yr HybridFull Time
MatX
MatX: Designing specialized AI chips for large language model workloads.
8+ YOEBS or higher in CS/EE or equivalent,8+ years systems software experience,deep Linux and low-level userspace/kernel experience,proficient in C and Go/Rust/C++/Python,experience with device drivers,cluster management,and cross-layer debugging.
Linux, Linux kernel, C, Go, Rust, C++, Python, HTTP/REST, Redfish, OpenBMC, BMC, gNMI, IPMI, PCIe