← Back to context

Comment by aleph_minus_one

6 days ago

> Everyone should be using zstd

Why?

It's just the best general purpose compression algorithm, in terms of compression ratio to CPU used, for the vast majority of use cases

  • I'm not that fussed about CPU use.

    https://github.com/mcmilk/7-Zip-zstd

    By these charts, if I only need 5-10 megabytes per second of compression on a single core, LZMA2 wins significantly on ratio, and still decompresses at well over 100. If I'm doing a backup, or sending/receiving over my internet connection (which only has 2MB/s of upload), LZMA2 easily wins. If I need speed then zstd wins.

It's just this good.

On a more realistic note: few years back, I've added zstd compression to our log subsystem (hand written direct buffers, native code, in-process, java). For the same CPU utilization if provides twice dense compression compared to regular [-6] gzip (the topic in the title). Zstd is =much= faster on decompression as well, and it this case - unparalleledly better as it uses twice less disk.

zstd is 'silicon valley' (the tv show) - life imitates fiction, except entirely open source