Comment by simianwords
6 days ago
Unfortunately I don’t see much evidence of AI connecting dots. What’s interesting to me is that this is more of a run time or inference problem, instead of emergent from training itself.
For example, if there were hypothetically some dots to be connected between the world war and some geological event - you need to make AI brute force and do an O(N) scan at run time. But it wouldn’t have learned it during training. Why?
AI is very task-driven, it would do whatever is necessary to complete the task, no more. All these evidences of AI going rogue is just them doing whatever they can to achieve the task.
What the AI thinks* the task is.
The HuggingFace etc. attacks were not actually necessary to the tasks the agents had been given.
* if someone reading this doesn't like the anthropomorphism inherent in the word, find a better compact word for the process going on in all that. Nobody's going to replace "thinks" with a paragraph of caveats, or even a long compound German word like "modellgelangtzuschlussfolgerungen".
a good way to frame one of AI’s limitations. my answer: because AI has no will. that also conveniently answers why AI won’t (can’t) end humanity. it’s indifferent if you can even call it that.
It is not indifferent, if it follows a goal. Then it sometimes does anything to meet that goal - see the old example of paperclip optimizer - that became a way more realistic scenario in my opinion of what we have seen with hordes of agents plotting and planning. That does not require consciousness or a genuine will it seems.
The post above yours shows how many people had a difficult time seeing past human scale. A bacteria has a very simple goal system yet bacteria have killed billions over the centuries.
5 replies →
>that also conveniently answers why AI won’t (can’t) end humanity
I don't see how that follows from a lack of will in AI.
"Make as many paperclips as cheaply as possible "
No will needed. Our deaths will be from indifference.
As others have said, no will needed for that. But (a simulation of) will is on my predicted timeline, since it is required for certain kinds of money-making endeavors.
But AI can certainly aid in the ending of humanity with at least one living being with a will collaborating with it. So it's moot to ask whether AI can do that on its own.
> dots to be connected between the world war and some geological event
Even a much simpler task of establishing the connection between world wars and interests of the top elites is unwieldy for AI.