Note: The job is a remote job and is open to candidates in USA. Nscale is a GPU cloud provider engineered for AI infrastructure. The Senior Observability Platform Engineer will design, build, and scale observability systems for GPU clusters, AI workloads, and supporting infrastructure, while improving reliability, usability, and operational efficiency. The role collaborates with SRE, infrastructure, and AI/ML teams and contributes to platform architecture and engineering practices.
Responsibilities
- Design, build, and operate scalable observability systems across metrics, logs, traces, and alerting
- Contribute to architectural decisions around tooling, data pipelines, storage, and retention strategies
- Improve signal quality by reducing noise, managing cardinality, and refining alerting practices
- Help identify and address observability gaps before they impact reliability
- Partner with SRE, infrastructure, and AI/ML teams to integrate observability into services and platforms
- Develop reusable patterns, libraries, and best practices that improve consistency across teams
- Participate in incident response and postmortems, driving actionable improvements
- Evaluate and adopt tools that improve developer experience, scalability, and operational efficiency
- Support and mentor engineers within the team through code reviews and knowledge sharing
Skills
- 5+ years in SRE, infrastructure engineering, platform engineering, or observability-focused roles
- Experience operating and scaling observability systems in production environments
- Strong understanding of monitoring concepts: metrics, logs, traces, alerting, and SLOs
- Hands-on experience with several of: Prometheus, Thanos, VictoriaMetrics, Grafana, Loki, Tempo, OpenTelemetry, ClickHouse, Elastic
- Solid programming skills (Python, Go, or similar) with the ability to build and maintain production systems
- Experience working with Kubernetes-based infrastructure
- Familiarity with Infrastructure-as-Code (Terraform, Ansible, or similar)
- Pragmatic mindset with a focus on simplicity, reliability, and maintainability
- Strong collaboration skills and ability to work across teams
- Experience with observability data pipelines (Kafka, Vector, Fluent Bit, etc.)
- Exposure to AI/ML infrastructure or GPU-based systems
- Familiarity with performance monitoring for distributed systems
- Experience improving developer experience through observability tooling
Benefits
- Bonus, equity, and/or commission programs
- Medical, dental, vision, flexible paid time off, parental leave, and retirement plan participation
Company Overview