Comment by menziess
2 days ago
The link leads to the readthedocs. The library can be used to parallelize data processing. `AsyncIterables` can be used a data sources, and any `Callable` can be used as a sink. RocksDB is used to preserve state. Checkpoints are used to detect stream downtimes, which will pause dependent streams until the dependency streams have recovered and have caught up.
No comments yet
Contribute on Hacker News ↗