Note: The job is a remote job and is open to candidates in USA. Nscale is a GPU cloud company engineered to provide high-performance infrastructure for AI startups and enterprises. The Staff Software Engineer will build and own domain-level architecture for Fleet Manager, a Python-based workflow automation platform that provisions, validates, monitors, and remediates GPU nodes and network switches. The role focuses on distributed systems, infrastructure automation, reliability, observability, and technical leadership.
Responsibilities
- **Domain-level technical direction.** Own the architecture for a major Fleet Manager domain — such as provisioning, validation, or remediation — influencing engineers across the team and adjacent squads
- **Design and build production-grade automation.** Implement device provisioning, burn-in testing, network configuration, and hardware health validation workflows in Python
- **Engineer for reliability and auditability.** Treat idempotency, resumability, checkpointing, retries, replay, and failure handling as first-class design concerns
- **Integrate broadly.** Connect Fleet Manager with datacenter infrastructure management systems, cloud orchestration platforms, and bare-metal provisioning tools
- **Create leverage through standards.** Establish shared patterns, libraries, conventions, and operational runbooks that other engineers build on
- **Own production outcomes.** Operate what you build with strong observability, alerting, incident response, and day-2 operational discipline
- **Mentor and influence.** Raise the bar through design reviews, implementation guidance, and operational best practices
- **Use AI to accelerate delivery** while maintaining architectural coherence
Skills
- Extensive experience designing, building, and operating distributed systems in production, ideally in infrastructure automation, workflow tooling, or platform engineering
- Strong proficiency in **Python** — Fleet Manager is built entirely in Python
- Strong understanding of event-driven and workflow architecture, including reliable delivery, idempotency, retries, replay, and failure handling
- Track record of delivering automation systems from ambiguous requirements to production, with hands-on day-2 operations experience (monitoring, incident response, performance optimization)
- Proven ability to lead ambiguous technical work across team boundaries and drive domain-level delivery through influence rather than formal authority
- You are driven by building distributed systems at scale, infrastructure reliability, scalability, security, and continuous improvement
- You use AI tools like Claude or Cursor as a core part of your development workflow to create leverage, increase quality, and accelerate delivery
- Excellent communication skills to build consensus with stakeholders, both internally and externally, in a fast-paced, high-agency environment
- Experience with workflow orchestration tools like Temporal, Airflow, Prefect, or similar
- Hands-on experience with infrastructure tooling: DCIMs, NetBox, OpenStack, or ERP systems
- Bare-metal provisioning and automation: MAAS, Ironic, IPMI, PXE boot, or network automation
- Experience building hardware lifecycle automation: provisioning, validation, testing, or remediation workflows
- GPU infrastructure experience: health monitoring, burn-in testing, or cluster management
- HPC and networking: datacenter topology, high-performance interconnects (InfiniBand, RoCE)
- Deep knowledge of Kubernetes, Infrastructure as Code (Terraform, Pulumi), AWS, and GCP
- Open-source contributions in infrastructure automation or cloud-native tooling
Benefits
- This role may be eligible for bonus, equity, and/or commission programs.
- Medical, dental, vision, flexible paid time off, parental leave, and retirement plan participation.
Company Overview