Note: The job is a remote job and is open to candidates in USA. Mainz Brady Group is seeking a Senior Site Reliability Engineer to provide reliability support for AI platforms and infrastructure environments. The role focuses on platform reliability, production troubleshooting, incident response, observability, operational automation, and improving the availability and resilience of AI/ML services.
Responsibilities
- Operate and improve the reliability of AI platform services, cluster dependencies, and shared infrastructure
- Lead and support incident triage involving Kubernetes, Linux, storage, networking, scheduling platforms, job orchestration, and dependency failures
- Define and improve SLIs, SLOs, alerting thresholds, runbooks, escalation paths, and post-incident corrective actions
- Analyze recurring failures and turn manual operational processes into automation and preventative controls
- Build observability across systems and services using metrics, logs, traces, and event correlation
- Troubleshoot performance and availability issues impacting AI/ML training workloads, inference services, and internal platforms
- Partner with infrastructure and validation teams to improve production readiness and change-management safety
- Drive operational reviews, resilience testing, and readiness assessments
Skills
- 7+ years of SRE, production operations, or reliability-focused infrastructure engineering experience
- Strong hands-on expertise with Linux, Kubernetes, networking, and distributed systems
- Experience building observability, monitoring, alerting, and incident-response workflows
- Strong scripting and automation experience with Python, Bash, Go, or similar technologies
- Experience with incident management, root cause analysis, and post-incident remediation
- Ability to automate repetitive operational processes and reduce production support overhead
- Strong troubleshooting skills across complex, highly available production environments
- Excellent communication and ability to work across technical teams
- AI platforms, machine learning infrastructure, or large-scale HPC environments
- Prometheus, Grafana, ELK Stack, OpenSearch, Loki, and PagerDuty
- Defining and managing SLIs, SLOs, and error budgets
- Supporting both batch and service-based workloads
- Cloud and data center infrastructure
- Logging, tracing, infrastructure monitoring, and service reliability tooling
Company Overview