Comment by mlsu
17 hours ago
Classic alignment problem.
Despite nobody at openAI thinking of themselves as an asshole; despite society urging openAI not to be an asshole; despite the fact that being an asshole is entirely unnecessary even to accomplish whatever objective they are setting out to accomplish; despite everyone at openAI loudly declaring: we are not assholes!
They are still assholes.
reddit comment
This is maybe the lowest-quality comment on a thread full of them. Do better.
On the contrary, I found it a nice piece of rethoric to reflect on how misaligned incentives can overrule each individual's preferences in order to induce the group to take the opposite path.
It's done in jest but I think I am accurately pointing out the interesting parallels between what these companies say they are doing (aligning models) and what they are not doing (aligning themselves).
If you listen to them, and you don't have to listen very hard to hear it, basically everyone at these labs is telling us that this technology is extremely dangerous and should be slowed down or paused entirely. Yet, they, the only entities with the power to actually do anything about it, are not acting AT ALL as if that's the case. They are all barrelling forward as quickly as possible. RSI, THE number one risk according to these guys, is being adopted at breakneck pace up and down the stack, from designing silicon, to training, to inference.
It's ridiculous and insane and I believe can be accurately summed up as, they are being assholes, because if they are actually right about this we are all gonna die. At the very least, and far more likely, every fun creative expressive human thing that is machine legible will be replaced by a torrent of machine slop. It's not "benefiting humanity." These mathematicians are telling you it's not benefiting humanity. It sucks.
Alignment problem.