Comment by EagnaIonat

> did tests years ago with LLMs inventing their own languages.

That was the media hype about it. There were two incidents.

1. Using a RL to train a model, it found that it got rewarded for certain garbage phases, so continued to talk that way.

2. Certain Latin words for fish/birds were used instead of "fish" or "bird". Just a token issue.