Comment by geenat
16 hours ago
Oh man, tons of updates including DDL replication! V2 looks very impressive.
Now I'm curious how sharding/routing is handled- which seems like the final piece of the puzzle for scaling writes.
16 hours ago
Oh man, tons of updates including DDL replication! V2 looks very impressive.
Now I'm curious how sharding/routing is handled- which seems like the final piece of the puzzle for scaling writes.
Right now I've started off with full replication of every database in cluster. On my roadmap I have:
- Ability to launch a replica on selected databases from main cluster.
- Ability for replica to only download and replicate changes of select databases (right now all or nothing).
- Ability for replica to proxy DML & DDL into write cluster transparently.
- Custom set of commands for replicas to download and attach/detach databases on the fly.
This will instantly solve 80% of the problems for most of consumption today. I will probably go after on demand page stream and other stuff once core features are done.
Not to mention this solves majority use-cases of lambdas. One can have a persistent main cluster, and then lambda's coming up or going down on demand transparently.