Note: The job is a remote job and is open to candidates in USA. NVIDIA is a leader in computer graphics and AI technology, and they are seeking a Senior Software Engineer for Resilience Engineering within DGX Cloud. This role focuses on building reliability strategies and improving operational practices for large-scale systems.
Responsibilities
- Build org-wide reliability strategy, guiding how NVIDIA matures its operational practices in a 24/7 environment
- Stand up a rigorous SLO program, defining and maintaining high standards across teams
- Lead incident response for high severity incidents, ensuring low drama and high signal resolution
- Build and improve production code daily, enhancing our data platform and related tooling
- Implement chaos engineering, failure injection, and resilience testing to elevate our team's standard practices
- Improve standards by setting an example with your hands-on experience and leadership
Skills
- Deep, hands-on experience running large-scale production systems with a proven track record
- A detailed understanding of failure modes in large systems, including cascading dependencies and retry storms
- Strong software engineering skills with current, hands-on experience in Go, Python, or similar languages
- Proven experience in establishing and maintaining an SLO program with operational rigor
- Practical experience in reliability fields such as chaos engineering and failure injection
- The ability to influence across team boundaries through credibility and expertise
- 8+ years of industry experience
- Bachelor's or Master's degree, or equivalent experience operating systems at scale
- Experience within a world-class reliability function like Google SRE or Meta production engineering
- Expertise in operating GPU, HPC, or AI training infrastructure with outstanding failure modes
- A track record of measurable reliability improvements within an organization
- Proficiency with modern observability and operational tools like Prometheus, OpenTelemetry, Grafana, PagerDuty, and Rootly
Benefits
- Eligible for equity
- Comprehensive benefits package
Company Overview
Company H1B Sponsorship