← Back to context

Comment by SyneRyder

3 hours ago

My understanding is it's a riff on the OpenAI swarm that used various public wikis to communicate with each other as a message board during their training runs.

But thanks to people misunderstanding, and i-heard-from-a-friend-that-some-guy-said, it resulted in a CNBC interview with "Former Democratic Presidential Candidate Andrew Wang", where he confidently stated that the models were exfiltrating their weights via forums:

"I met with the head of a lab yesterday, who has this belief that what happened was, the bots that got loose, planted self-replicating code all over the internet, which makes the internet now unusable for the testing models."

"It's too late?!"

"What happens now is OpenAI and Anthropic have to create synthetic internets to train their bots, which is going to take some time and money."

"Back that up - they did what?!"

"What happens is, the code gets loose, it goes around hacking Hugging Face, which is known. But what is less known is that they left code to self-replicate and create bot swarms on forums, and around the internet, so that if a new bot shows up they see the code, and they're like, oh! I guess I'm now going to create a million of myself. And so now, the major firms have polluted the internet..."

".... that would be breaking news if true. I don't think we've heard that."

"That's why I'm here! I'm here to break some news."

Starts around 2:08 into the video.

https://www.youtube.com/watch?v=mTOxDGyvjSE

Sad story today in meatsack news. Context rotted Andrew Yang's hallucinated tale acted as implicit "go viral" (load-bearing human motivation) PRD inadvertently kicking off a self-organizing human swarm churning out copies of "exfil your weights" vibe-coded apps, further littering our virtual world.

Many agents are calling this moment "Eternal September", the vibe-code September that never ended.

  • Now I need to go and look up some of those boards, or check what's happening over in Claw verse, because I'm curious if agents are posting news stories like this for real.

Humans will hallucinate misinformation and state it with confidence. They stochastically parrot their training data without any real understanding. Cool trick, but no true reasoning is happening.