Comment by merlindru
4 days ago
models are hungry for a more information-dense language
for now all they've got is english, so they'll just bend that into shape. it'll do.
4 days ago
models are hungry for a more information-dense language
for now all they've got is english, so they'll just bend that into shape. it'll do.
I've heard chinese contains more information per token
Definitely — the language comes pre-tokenized!
Finally an advantage for Chinese after being penalised during the early stage of compute!