Comment by ozgrakkurt

Makes sense. For rle and dictionary encodings I probably won’t use the 1024 block size to split the input.

1024 for block size is just for being able to vectorize delta encoding and bit packing.

I am using this library for compressing individual pages of columns in a file format so the page size will be determined there.

I’m not using fastlanes to do in-memory compressed arrays like it is originally intended for. But I’ll export the fastlanes API in next version too, so someone can implement it themselves if needed