Comment by apsurd
6 days ago
a good way to frame one of AI’s limitations. my answer: because AI has no will. that also conveniently answers why AI won’t (can’t) end humanity. it’s indifferent if you can even call it that.
6 days ago
a good way to frame one of AI’s limitations. my answer: because AI has no will. that also conveniently answers why AI won’t (can’t) end humanity. it’s indifferent if you can even call it that.
It is not indifferent, if it follows a goal. Then it sometimes does anything to meet that goal - see the old example of paperclip optimizer - that became a way more realistic scenario in my opinion of what we have seen with hordes of agents plotting and planning. That does not require consciousness or a genuine will it seems.
The post above yours shows how many people had a difficult time seeing past human scale. A bacteria has a very simple goal system yet bacteria have killed billions over the centuries.
You are right. We should also hold other threats to humanity: war, meteors, pandemics.
I'm obviously pointing out the (unsubstantiated) exceptional threat that we're all seemingly worried about: that ASI requires alignment because it'll otherwise cause the end of humanity.
4 replies →
>that also conveniently answers why AI won’t (can’t) end humanity
I don't see how that follows from a lack of will in AI.
"Make as many paperclips as cheaply as possible "
No will needed. Our deaths will be from indifference.
As others have said, no will needed for that. But (a simulation of) will is on my predicted timeline, since it is required for certain kinds of money-making endeavors.
But AI can certainly aid in the ending of humanity with at least one living being with a will collaborating with it. So it's moot to ask whether AI can do that on its own.