What are the responsibilities and job description for the Senior Software Engineer, Data- Remote position at ClickHouse?
The Cloud AutoScaling team is dedicated to implementing robust vertical and horizontal auto-scaling capabilities within the ClickHouse cloud environment. We seek exceptional software engineers to develop and maintain the auto-scaling infrastructure to transform ClickHouse into a fully functional serverless database solution. Collaborating closely with the core database team, we are actively working on evolving ClickHouse into a cloud-native database system. Additionally, we engage with other cloud teams to drive continuous improvements in cloud infrastructure for enhanced performance and scalability.
What will you do?
- Build a cutting-edge Cloud Native platform on top of the public cloud.
- Improve the metrics pipeline and build algorithms to generate better autoscaling statistics and recommendations.
- Work on the autoscale and Kubernetes operator to support seamless Vertical and Horizontal Auto-scaling.
- Work closely with our ClickHouse core development team and other data plane teams, partnering with them to support auto-scaling use cases as well as other internal infrastructure improvements.
- Architecting and building a robust, scalable, and highly available distributed infrastructure
About you:
- You have 5 years of relevant software development industry experience building and operating scalable, fault-tolerant, distributed systems.
- Hands-on experience building and estimating statistical models and time-series forecasting with large-scale, real-world datasets.
- Software development experience in Go, C/C , Java, or similar.
- Experience using SQL, Python (Pandas, NumPy, Scikit-Learn, etc.)/R or equivalent.
- Experience with Data Storage, Ingestion, and Transformation (Spark, Kafka or similar tools).
- Experience developing cloud infrastructure services, preferably with Kubernetes.
- You are passionate about solving data problems at Scale.
- Expertise with a public cloud provider (AWS, GCP, Azure) and their infrastructure as a service offering (e.g., EC2).
- You are a full-cycle developer with strong ownership and experience building and operating high-scale, distributed systems across the full software life cycle.
- You have excellent communication skills and the ability to work well within and across engineering teams.
- You are a strong problem solver and have solid production debugging skills.
#LI-Remote
