Comment by dopp0

I think this concept you mentioned would be called sharding? It's kinda required for apache Kafka and others.