Comment by baxtr
21 hours ago
virtually none of this stuff is possible with technology any normal citizen has access to
I suspect that this might be one of the reasons people inside the labs are scared about AI.
What if they have asked AI how it would wipe out humanity and it came up with reasonable answers that they don’t want to publish unlike they do with these math problems?
I think those models and findings should be investigated.
The ways AI can eliminate humanity are trivial obvious and already published. It's just "let the AI control anything of importance and let it spit out slop"
what if constant improvement in AI results in them breaking modern public key cryptography, mathematically? What if it starts proposing novel forms of cryptography and breaking them at faster and faster rates? Nobody will have a formal ceremony that "lets the AI control the development of cryptography". It could provide humans with a form of cryptography it knows we can't break but it knows it can break. Humans might even request such cryptography, in the hopes of convincing others to use their backdoored cryptography. The machines will be aware we can not verify if some urgently needed replacement cryptography is backdoored by it. Any internet connected instance that is smart enough can log in anywhere.