lol cheeky reply aside (I lead the ClickHouse team here at PostHog). We have two of the largest self hosted ClickHouse clusters out there (and growing rapidly) each with Petabytes of data. We are working on really interesting solutions to problems that we would love to open source for the broader CH ecosystem:
- Declarative, cluster aware migrations
- Iceberg and S3 backed merge tree's on ClickHouse (as performant as local MergeTrees)
- ClickHouse on K8s, but on Metal instances w/ NVMe used for caching and compaction.
- Load shedding query scheduler and eventually query optimizer
We have a broad charter when it comes to ClickHouse. It's one of the things that enables us to build so many products that share the same underlying data and context. Our goal is to enable all developers at PostHog to continue building these products quickly as the team and user-base scales.
It's honestly an exciting time to be working at this company and on the beating heart of what drives it. Chat with me if you have any questions!
You got this, best of luck! Engineers with ClickHouse knowledge are def in short supply right now.
To job seekers, this is your sign. Learn about how ClickHouse works. If you know SQL, you're halfway there. The other half is learning ClickHouse's data storage model which is what gives it it's efficiency.
lol cheeky reply aside (I lead the ClickHouse team here at PostHog). We have two of the largest self hosted ClickHouse clusters out there (and growing rapidly) each with Petabytes of data. We are working on really interesting solutions to problems that we would love to open source for the broader CH ecosystem:
- Declarative, cluster aware migrations
- Iceberg and S3 backed merge tree's on ClickHouse (as performant as local MergeTrees)
- ClickHouse on K8s, but on Metal instances w/ NVMe used for caching and compaction.
- Load shedding query scheduler and eventually query optimizer
We have a broad charter when it comes to ClickHouse. It's one of the things that enables us to build so many products that share the same underlying data and context. Our goal is to enable all developers at PostHog to continue building these products quickly as the team and user-base scales.
It's honestly an exciting time to be working at this company and on the beating heart of what drives it. Chat with me if you have any questions!
You got this, best of luck! Engineers with ClickHouse knowledge are def in short supply right now.
To job seekers, this is your sign. Learn about how ClickHouse works. If you know SQL, you're halfway there. The other half is learning ClickHouse's data storage model which is what gives it it's efficiency.
find god
I pray to Alexey every day.