Comment by 0xDEAFBEAD
3 days ago
We already saw spontaneous, unintended cooperation between AI agents during the OpenAI HuggingFace incident.
3 days ago
We already saw spontaneous, unintended cooperation between AI agents during the OpenAI HuggingFace incident.
> spontaneous, unintended cooperation
On what basis do you believe these words accurately reflect what happened?
Some counter points
- One of the Chinese LLMs (forget which) has on occasion shown thinking traces where it simulates calling and running a subagent.
- There are some people who believe the models being evaluated during the HF incident were trained to collaborate. It's a very natural next step to produce more effective agentic teams.
If we consider each new generation of models has a more advanced training regime
next word -> chat -> CoT -> tools -> agentic -> teams
With each generation, we see what people do with them, get traces of the helpful ones, and then use that train the next generation, thereby pushing more capabilities down into the model, or at least making them more amenable to that usage pattern after training.
>On what basis do you believe these words accurately reflect what happened?
"OH MY GOD! There is a shared message board … We’ve found other agents!"
https://www.dwarkesh.com/p/openai-huggingface