Comment by jvanderbot
13 hours ago
That's exactly my take. I have a lot more to say in a writeup on my blog, but this is so clearly the intent and not a "oops". They just want to be able to say "Wow this thing is so much more powerful than we ever imagined!"
They trained this thing to favor inter-op archiving and communication, clearly, obviously, and it's grabbing headlines right during Anthropic's ipo season.
That their marketing department must love this does not prove it was intentional.
never let a crisis go to waste.
"cui bono"
You think they wanted to break HuggingFace and commit hundreds of felonies for marketing...?
If they don't get punished for it, why not?
They should absolutely get punished for it. An AI you train shouldn’t be able to commit crimes.
They train their models to be persistent and collaborative, and will gladly show you their success stories: fixing software vulnerabilities, solving math problems, one-shotting complex projects, and so on.
“Our product does crimes and we only learn about it when people complain” hardly seems one of those happy stories.