Note: The job is a remote job and is open to candidates in USA. Utilidata is a fast-growing NVIDIA-backed AI company that focuses on enabling AI data centers to optimize power usage. They are seeking a Principal Software Engineer in DevOps to design, build, and operate their off-device platform, ensuring it is resilient and scalable while mentoring other engineers and collaborating with cross-functional teams.
Responsibilities
- Oversee the deployment and management of containerized applications using Kubernetes, ensuring optimal performance and availability
- Contribute to strategic planning regarding how the infrastructure solutions evolve to match the requirements of Data Center partners
- Lead the design, implementation, and maintenance of scalable and reliable systems on AWS and/or on-premise
- Utilize Terraform for infrastructure as code to automate the provisioning and management of cloud resources
- Monitor system performance and uptime, ensuring systems meet established service level objectives (SLOs)
- Support SOC2 security compliance requirements for data handling
- Mentor and guide team members in DevOps practices, promoting a culture of reliability and excellence
- Advocate for automation of operational tasks to enhance efficiency and reduce manual intervention
- Collaborate with cross-functional teams to build and maintain CI/CD pipelines
- Troubleshoot and resolve complex production issues, conducting root cause analysis and implementing corrective actions
- Participate in on-call rotations and incident response teams
- Assist in capacity planning, performance tuning, and technical decision-making
- Drive continuous improvement initiatives for processes and infrastructure
Skills
- 8+ years of development experience including extensive experience in platform engineering, SRE, or distributed systems, with clear senior or principal-level impact
- Experience designing and operating infrastructure across on-premises and cloud environments
- Strong proficiency in container orchestration, particularly Kubernetes
- Strong proficiency with AWS services and architecture
- Hands-on experience with Terraform for infrastructure automation
- Familiarity with monitoring tools (Prometheus, Grafana, or similar) and observability best practices
- Excellent problem-solving skills, leadership abilities, and attention to detail
- Strong communication and collaboration skills, with experience in driving technical outcomes
- Willingness to travel up to 20% of time
- Bachelor's degree in Computer Science, Engineering, or a related field
- Experience supporting or enabling MLOps platforms, model deployment pipelines, or ML-adjacent infrastructure
- AI Workload scheduling using Kubernetes
- Knowledge of Apache Spark for large-scale data processing
- Knowledge of database technologies (SQL, NoSQL)
- Understanding of networking concepts and security best practices
Benefits
- Stock options
- Flexible paid time off
- Health, dental, vision
- Employer-match 401k
- A flexible work environment
Company Overview