Comment by throwanem
1 year ago
And the guy who's already argued for airstrikes on datacenters considers that to be good news? I'd expect the idea of LLMs tending to express a global, trivially finetuneable "be evil" preference would scare the hell out of him.
He is less concerned that people can create an evil AI if they want to and more concerned that no person can keep an AI from being evil even if we tried.
He expects the bad guy with an AI to be stopped by a good guy with an AI?
No, he expects the AI to kill us all even if it was built by a good guy.
How much this result improves his outlook, we don't know, but he previously put our chance of extinction at over 95%: https://pauseai.info/pdoom
2 replies →
No, he expects a bad AI to be unstoppable by anybody, including the unwitting guy who runs it.
works for gun control :)
1 reply →
I guess the argument there would be that this news makes it sound more plausible people could technically build LLMs which are "actually" "good"...