Comment by WhyNotHugo
2 days ago
This is pretty much Chinese grammar with English words. In Chinese you'd say "need ask" or "I need ask" if you want to be unusually verbose, but there's no "to".
All your examples align with this too. It just sounds to me like its optimising by removing the superfluous English words and thinking more Chinesely.
After learning a little Mandarin I was amazed at how much simpler the Chinese grammar is than all Latin, Germanic, Romance, etc languages.
No gender, cases, tenses, conjugation, articles, word order inversion, etc. It's remarkable.
Mandarin has it's own complexities but grammar wise, it feels more optimized or simpler.
Has nothing to do with Chinese.
Frontier labs have already been doing this for a while, verified in smuggled traces from OAT/Ant.
Simply a way to reduce tokens.
https://github.com/juliusbrussee/caveman