Comment by jpgvm
5 years ago
What you want is called Apache Pulsar. Log when you need it, work queue when you need that instead.
As for ensuring transactional consistency that isn't so bad, you can use an table to track offset inserts making sure you verify from that before you update consumer offsets (or Pulsar subscription if you go that route).
No comments yet
Contribute on Hacker News ↗