Comment by trhway

And as a result additional illegibility arises - LLMs inventing their own languages looking as meaningless garbage to humans. One can wonder whether decoding such a language will provide a bit more view into the LLM’s “thinking “.