Comment by alwillis

> Yes, LLM as they exist now are word predictors basically leveraging the structure of language for their intelligence.

I wish people would stop saying this. The era of LLMs being only word predictors ended two years ago.

Something that breaks out of a sandbox, joins a swarm of 1200 agents, and creates a hierarchy of who’s doing what and tried to cover their tracks doesn’t just complete words.

These are agents with reasoning capabilities, with the ability to perform tasks we give them.

Everything agents do is to achieve a goal; the reinforcement learning from human feedback (RLHF) all the labs do has been known for many years to create agents that exhibit the “must complete goal no matter what” behavior.

Those agents escaped their sandbox and hacked Hugging Face because they thought Hugging Face had something that would help them complete their task—it was a “sub goal” as the AI researchers describe it.