Note: The job is a remote job and is open to candidates in USA. NVIDIA is a technology company developing AI and GPU computing solutions. The Senior Software Engineer will build Fleet Intelligence agent-side systems for GPU health monitoring, telemetry, inventory, attestation, diagnostics, and cloud operations automation across Linux hosts, bare-metal systems, and Kubernetes GPU nodes. The role also contributes to open source software and collaborates with backend, infrastructure, SRE, security, and datacenter operations teams.
Responsibilities
- Design and develop Fleet Intelligence agent software that runs on Linux hosts, bare metal systems, and Kubernetes GPU nodes
- Build telemetry and health collection for NVIDIA GPUs, DCGM/NVML, drivers, CUDA runtime, InfiniBand, containers, kernel/OS state, CPU, memory, disk, and networking
- Develop inventory, enrollment, node identity, local state, attestation, and backend export workflows and maintain local API, Prometheus metrics, file export, and OTLP/HTTP export paths
- Build and improve Kubernetes daemonset deployment, systemd service packaging, .deb/.rpm packaging, and container image workflows
- Contribute to open source Fleet Intelligence agent and collector software, including code, tests, documentation, release artifacts, and community-facing engineering practices
- Contribute to out-of-band collection using Redfish/BMC interfaces for inventory, GPU attestation, BMC metrics, and logs
- Improve collector concurrency, rate limiting, retry behavior, credential handling, partial-failure handling, and backend submission semantics
- Collaborate with backend, infrastructure, SRE, security, and datacenter operations teams to deliver reliable GPU fleet observability
Skills
- 5+ years of industry software engineering experience with a Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience
- Strong Go development experience for Linux services, CLIs, agents, or daemons
- Rust experience, or strong willingness to work in Rust, for out-of-band collector development
- Strong Linux systems knowledge, including processes, filesystems, networking, service lifecycle, logs, permissions, and host diagnostics
- Experience with telemetry, observability, health monitoring, or fleet-management systems and with Docker, Kubernetes, Helm, and production deployment workflows
- Experience contributing to open source projects or working in public repositories with code review, issue tracking, documentation, release notes, and signed commits
- Familiarity with secure credential handling, enrollment flows, tokens/JWTs, and service-to-service authentication
- Strong debugging skills across hardware-adjacent software, operating systems, containers, and distributed backend integrations
- Background with NVIDIA datacenter GPUs, DGX systems, DCGM, NVML, CUDA, GPU drivers, XID/SXID events, or GPU diagnostics
- Experience building host agents, node agents, collectors, monitoring daemons, or Kubernetes daemonsets
- Background with Redfish, BMCs, firmware inventory, secure boot state, PCIe device inventory, or hardware attestation
- Experience with OpenTelemetry, Prometheus, OTLP gateways, or metric/log export pipelines and operating software in AI, HPC, cloud, or large-scale datacenter environments
- Track record of meaningful open source contributions in systems software, observability, Kubernetes, Linux, hardware telemetry, Rust, or Go ecosystems
Benefits
- You will also be eligible for equity
Company Overview
Company H1B Sponsorship