Note: The job is a remote job and is open to candidates in USA. PostHog is hiring a ClickHouse Operations Engineer to automate, manage, and scale the ClickHouse infrastructure that supports its products and customers. The role focuses on provisioning large clusters, optimizing node- and instance-level performance, and developing query performance tooling.
Responsibilities
- We need someone to automate, manage, and maintain ClickHouse as we grow towards capturing trillions of events per year and having one of the world’s largest clusters
- This includes ClickHouse operations and scaling infrastructure, as well as node and instance-level performance optimization. We want to ensure that we have the right hardware deployed at the right time for each workload on ClickHouse
- You'll build systems and automations for the provisioning and scaling of our large ClickHouse clusters, handling over 100 PB's of data
- You'll have the ability to investigate and experiment using the latest hardware that cloud providers have to offer in order to find the optimal setup for our solution
- You'll be using Terraform, Ansible, and Kubernetes to automate the dynamic provisioning of instances and work on a bleeding edge ClickHouse implementation, like open format backed tables, and not just maintenance
- We're also building a query optimizer for ClickHouse, which means you will work on query performance tooling
Skills
- Experience: Any (new grads ok)
- US citizen/visa only
- You bring OLAP Database Experience
- We're looking for people that went into the internals of ClickHouse and other OLAP Databases, not high level users
- You bring experience in automating Dynamic provisioning instances
- Strong experience with utilizing Terraform, Ansible and K8s is important
- You bring experience with Scale and Complexity!
- We're building and operating high-scale complex data storage solutions, we need you to have experience with the challenges this brings
- We build using Python, Terraform, Ansible, Kubernetes, AWS, and Zookeeper (An alternative to Zookeeper is fine)
- If you bring strong experience with other OLAP Databases, that's great
Benefits
- Natively remote company
- Default to async communication
- Tuesdays and Thursdays are meeting-free days
- Prioritize heads down building time over perfect coordination
Company Overview