Comment by rdevilla
2 months ago
Only two or three weeks from incepting the idea of a token efficient LLM English dialect to seeing it in practice. I just never imagined it to take.... this particular form.....
2 months ago
Only two or three weeks from incepting the idea of a token efficient LLM English dialect to seeing it in practice. I just never imagined it to take.... this particular form.....
I've had the thought that English is an efficiency barrier for a while now. Surely there are more information-dense representations of semantic concepts.
Some languages for example have single characters that represent entire ideas/phrases.
https://news.ycombinator.com/item?id=47442478
https://en.wikipedia.org/wiki/Le_Taureau
"Everything should be made simple as possible but not simpler"