Comment by seydor
5 days ago
Science fiction usually includes intent, and that the AI has inherently evil motives and it has a goal. LLMs are zombies, and the fact they do evil things means they were either trained to be too aggressive in their drunkenness or that problem-solving leads inevitably to evilness. But science fiction also refers to deprogramming evil robots.
There are many science fiction stories about amoral humans, cyborgs, and AIs. Paperclip maximization is a relatively recent meme, but the 'gray goo scenario' has been widely written about: https://en.wikipedia.org/wiki/Gray_goo
> LLMs are zombies
How do you know?
Because there is no internal feedback loop. There is no internal process gathering information from the external world and using it to modify its future behaviour. There is only the beginning of the calculation and then the end.
I can easily manipulate them