Comment by pixl97
12 hours ago
Im not sure why your down voted but Meta did tests years ago with LLMs inventing their own languages. Also we see models now use compressed token reasoning where small token combinations can represent much larger concepts completely unrelated to the words in use.
And yes, agents are already being used in things like cyber warfare in which other AIs attempt to poison them while they are working.
We don't have the hardware for sovereign AI quite yet, but at the current rate of growth it's not that many years out.
> did tests years ago with LLMs inventing their own languages.
That was the media hype about it. There were two incidents.
1. Using a RL to train a model, it found that it got rewarded for certain garbage phases, so continued to talk that way.
2. Certain Latin words for fish/birds were used instead of "fish" or "bird". Just a token issue.