Comment by Rendello 1 month ago The hard-coded dictionary wouldn't be much stranger than Brotli's:https://news.ycombinator.com/item?id=27160590 1 comment Rendello Reply maxbond 1 month ago You can use a BPE variant like SentencePiece to identify these patterns rather than hard coding them.
maxbond 1 month ago You can use a BPE variant like SentencePiece to identify these patterns rather than hard coding them.
You can use a BPE variant like SentencePiece to identify these patterns rather than hard coding them.