← Back to context

Comment by willtemperley

9 hours ago

Another thing worth mentioning is it's very similar to the structure of columnar formats like Arrow and Parquet. Anyone with familiarity with these formats could build a decoder in a couple of days. If they don't use FastPFOR.

I really wish they hadn't used FastPFOR. It's a research library and has an incredibly opaque algorithm:

https://ayende.com/blog/199523-C/integer-compression-underst...