Comment by LgWoodenBadger 1 day ago Complicated parallelization? That’s what partitions and consumers/consumer-groups are for! 4 comments LgWoodenBadger Reply sarchertech 19 hours ago Of course they are, but I’m not controlling the producer. LgWoodenBadger 17 hours ago Producer doesn’t care how many partitions there are, it doesn’t even know about them, unless it wants to use its own partitioning algorithm. You can change the number of partitions on the topic after the fact. sarchertech 15 hours ago In this case it would need to use its own partitioning algorithm because of some specific ordering guarantees we care about. 1 reply →
sarchertech 19 hours ago Of course they are, but I’m not controlling the producer. LgWoodenBadger 17 hours ago Producer doesn’t care how many partitions there are, it doesn’t even know about them, unless it wants to use its own partitioning algorithm. You can change the number of partitions on the topic after the fact. sarchertech 15 hours ago In this case it would need to use its own partitioning algorithm because of some specific ordering guarantees we care about. 1 reply →
LgWoodenBadger 17 hours ago Producer doesn’t care how many partitions there are, it doesn’t even know about them, unless it wants to use its own partitioning algorithm. You can change the number of partitions on the topic after the fact. sarchertech 15 hours ago In this case it would need to use its own partitioning algorithm because of some specific ordering guarantees we care about. 1 reply →
sarchertech 15 hours ago In this case it would need to use its own partitioning algorithm because of some specific ordering guarantees we care about. 1 reply →
Of course they are, but I’m not controlling the producer.
Producer doesn’t care how many partitions there are, it doesn’t even know about them, unless it wants to use its own partitioning algorithm. You can change the number of partitions on the topic after the fact.
In this case it would need to use its own partitioning algorithm because of some specific ordering guarantees we care about.
1 reply →