← Back to context

Comment by thomasahle

2 years ago

These are good research topics, but then you really need to be comparing to other models in the same class.

The only other super cheap model they compare with is FastText, and FastText beat them quite substantially.

Gzip fails at audio and video compression IIRC?

Are time-domain signals better compressed with A/V codecs (compression-decompression); and does this gzip finding suggest that other compression algorithms likely to outperform LLMs at certain tasks like computational complexity, at least?