NVIDIA
Posted 5d ago

Senior Software Engineer, Fleet Intelligence Agent Systems

NVIDIA
Santa Clara or New York or United States
$152k-$288k/yrRemoteFull Time
Responsibilities
  • designing agents
  • building telemetry
  • improving collectors
Requirements
  • 5+ years of software engineering experience and a computer science
  • Computer engineering, or electrical engineering degree. Requires strong Go
  • Linux systems
  • Telemetry
  • Docker
  • Kubernetes, Helm, and production deployment experience
  • Rust experience preferred
Technical tools mentioned
GoRustLinuxKubernetesDockerHelmDCGMNVMLCUDAInfiniBandPrometheusOpenTelemetryOTLP/HTTPRedfishBMCsystemdDebian package (.deb)RPM Package Manager (.rpm)JSON Web Tokens (JWT)

Job description

Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPUs act as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent.

As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is encouraged to do their best work. NVIDIA is widely recognized as one of the most desirable employers, with some of the most versatile people in the world working for us. If you're passionate about building reliable systems software for cloud-scale GPU infrastructure, we encourage you to contribute to our team. We are looking for a Senior Software Engineer to join our DGX Cloud / Fleet Intelligence team and build agent-side systems that collect GPU health, host telemetry, inventory, attestation evidence, and BMC data across NVIDIA’s GPU fleet. This role includes contributing to open source software used by developers, operators, and customers working with NVIDIA GPU infrastructure.

What You'll Be Doing:

This role focuses on Fleet Intelligence in-band agent and out-of-band collector systems used for GPU health monitoring, host and BMC telemetry, inventory, attestation, diagnostics, and cloud operations automation, you will:

  • Design and develop Fleet Intelligence agent software that runs on Linux hosts, bare metal systems, and Kubernetes GPU nodes.

  • Build telemetry and health collection for NVIDIA GPUs, DCGM/NVML, drivers, CUDA runtime, InfiniBand, containers, kernel/OS state, CPU, memory, disk, and networking.

  • Develop inventory, enrollment, node identity, local state, attestation, and backend export workflows and maintain local API, Prometheus metrics, file export, and OTLP/HTTP export paths.

  • Build and improve Kubernetes daemonset deployment, systemd service packaging, .deb/.rpm packaging, and container image workflows.

  • Contribute to open source Fleet Intelligence agent and collector software, including code, tests, documentation, release artifacts, and community-facing engineering practices.

  • Contribute to out-of-band collection using Redfish/BMC interfaces for inventory, GPU attestation, BMC metrics, and logs.

  • Improve collector concurrency, rate limiting, retry behavior, credential handling, partial-failure handling, and backend submission semantics.

  • Collaborate with backend, infrastructure, SRE, security, and datacenter operations teams to deliver reliable GPU fleet observability.

What We Need To See:

  • 5+ years of industry software engineering experience with a Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience.

  • Strong Go development experience for Linux services, CLIs, agents, or daemons.

  • Rust experience, or strong willingness to work in Rust, for out-of-band collector development.

  • Strong Linux systems knowledge, including processes, filesystems, networking, service lifecycle, logs, permissions, and host diagnostics.

  • Experience with telemetry, observability, health monitoring, or fleet-management systems and with Docker, Kubernetes, Helm, and production deployment workflows.

  • Experience contributing to open source projects or working in public repositories with code review, issue tracking, documentation, release notes, and signed commits.

  • Familiarity with secure credential handling, enrollment flows, tokens/JWTs, and service-to-service authentication.

  • Strong debugging skills across hardware-adjacent software, operating systems, containers, and distributed backend integrations.

Ways To Stand Out From The Crowd:

  • Background with NVIDIA datacenter GPUs, DGX systems, DCGM, NVML, CUDA, GPU drivers, XID/SXID events, or GPU diagnostics.

  • Experience building host agents, node agents, collectors, monitoring daemons, or Kubernetes daemonsets.

  • Background with Redfish, BMCs, firmware inventory, secure boot state, PCIe device inventory, or hardware attestation.

  • Experience with OpenTelemetry, Prometheus, OTLP gateways, or metric/log export pipelines and operating software in AI, HPC, cloud, or large-scale datacenter environments.

  • Track record of meaningful open source contributions in systems software, observability, Kubernetes, Linux, hardware telemetry, Rust, or Go ecosystems.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 28, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

About NVIDIA

Computing platform for AI and accelerated graphics.

Similar jobs

Software Engineer roles near Santa Clara, California
7h
Save
Mark Applied
Hide
Software Engineer
Menlo Park or Seattle
$219k-$301k/yr OnsiteFull Time
Meta
MetaNASDAQ: META: Builds technologies that help people connect, find communities, and grow businesses.
10+ YOEBachelor's degree or equivalent experience, 10+ years in networking or infrastructure software, 4+ years designing production dataplane/control-plane systems, Kubernetes networking, C/C++, scripting, and test automation.
Kubernetes, C, C++, Python, Shell Scripting, DPDK, eBPF/XDP, AF_XDP, io_uring, RDMA/RoCEv2, Linux, TC/iptables/nftables
8h
Save
Mark Applied
Hide
Software Engineer Simulation Infrastructure
Cupertino or North America
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designing and manufacturing consumer electronics, software, and digital services.
Strong Python skills, HTTP service and relational database experience, frontend framework knowledge, cloud infrastructure experience, networking and debugging expertise, Linux/macOS background, and a CS degree or equivalent experience.
Python, FastAPI, Flask, Postgres, React, Kubernetes, TCP/IP, HTTP, WebSockets, SSH, Linux, macOS, Swift, C++, OIDC, OAuth
9h
Save
Mark Applied
Hide
Software Engineer
San Francisco, California, United States
OnsiteFull Time
Proximal
Proximal: Private San Francis research lab developing coding data and benchmarks for autonomous coding agents.
Experience designing scalable systems from scratch with strong correctness, reliability, and performance; experimental instincts, systems design judgment, and ability to solve ambiguous technical problems independently.
10h
Save
Mark Applied
Hide
Software Engineer, Simulation Systems
United States or San Francisco
$140k-$185k/yr RemoteFull Time
Aalyria
Aalyria: Private aerospace communications providing network-orchestration software and optical terminals to commercial and government customers.
5+ YOEBachelor's degree in computer science or related technical field or equivalent experience; 5+ years developing production software; proficiency in Golang, C/C++, or Java; distributed or complex backend systems experience.
Golang, C, C++, Java
11h
Save
Mark Applied
Hide
Senior Software Engineer, Network Datapath Monitoring
Sunnyvale, California, United States
$153k-$204k/yr OnsiteFull Time
CoreWeave
CoreWeaveNasdaq: CRWV: Specialized cloud provider for large-scale AI and machine learning.
5+ YOEBachelor's or master's degree in computer science, computer engineering, or related field; 5+ years of software engineering experience focused on networking and observability; expertise in protocols, routing, security, Golang or Python, SDN, virtualization, Kubernetes networking, and cloud infrastructure.
Golang, Python, TCP/IP, BGP, SDN, k8s, Kubernetes, k8s operators, controllers
11h
Save
Mark Applied
Hide
Software Engineer, Economy Platform
San Mateo, California, United States
$153k-$197k/yr HybridFull Time
Roblox
RobloxNYSE: RBLX: Global platform for user-created immersive digital experiences.
1+ YOE1–3 years of software engineering or computer science experience; knowledge of REST, API design, scalable containerized systems, microservices, quality metrics, and monitoring.
REST, API, containerized systems, microservices, Roblox Studio IDE, PC, Mac, iOS, Android, Xbox, Oculus Rift
12h
Save
Mark Applied
Hide
Software Engineer, Applied AI Research
North America or San Francisco
$180k-$400k/yr RemoteFull Time
Hightouch
Hightouch: N Agentic Marketing Platform powered by the industry-leading Composable CDP.
Strong technical skills in backend architecture or probabilistic systems, quantitative thinking, creativity with LLM applications, and product intuition; no prior LLM or AI experience required.
LLM, AI
13h
Save
Mark Applied
Hide
Principal Software Engineer
Redmond or San Francisco or New York City
$143k-$275k/yr RemoteFull Time
Microsoft
MicrosoftNASDAQ: MSFT: Multinational technology providing software, cloud, and AI solutions.
6+ YOEBachelor's degree in computer science or related field and 6+ years of technical engineering experience with coding; expertise in distributed systems, performance engineering, and technical leadership required.
C#, Java, C++, Rust, C, JavaScript, Python