Comment by odie5533
1 year ago
I've been referring to this post about issues with Celery: https://docs.hatchet.run/blog/problems-with-celery
Does PgQueuer address any of them?
1 year ago
I've been referring to this post about issues with Celery: https://docs.hatchet.run/blog/problems-with-celery
Does PgQueuer address any of them?
At first glans i i see two thins that PgQueuer can. It has native async support, it you can also have sync functions, they will be offloaded to threads via anyio (https://github.com/janbjorge/PgQueuer/blob/99c82c2d661b2ddfc...)
It has a global rate limit, synced via pg notify.
PgQueuer seems pretty similar to Hatchet - both use Postgres, require their own worker processes, both support async. Hatchet seems to be a lot more powerful though: cron, DAG workflows, retries, timeouts, and a UI dashboard.
https://github.com/tktech/chancy is a very early-stage pet project to work around specific issues I keep running into with Celery that has all of this, including a simple plugin-extendable UI with DAG workflow visualization.