Sure, all lethal weapons are a horrific nightmare on some level.
But you also have to keep in mind that China, Russia and Hamas will gladly develop them anyway. Until we've figured out the worldwide peace thing, we need to keep running the race, awful as it is.
But AI weapons aren't horrific in some way common to "all lethal weapons." They have that and more.
AI weapons are specially horrific in the way they have potential put massive and specific lethal power under the total control of a small number of people, in a way (like all AI) that basically cuts most of humanity out of the future (or at the very least puts them under a boot where no escape is imaginable).
In some ways, they're even worse than nuclear weapons. A nuclear attack is an event, and if you survive there's some chance of escape. Station 100,000 fully automated drones around a city with orders to kill anything that moves, and the entire population will be dead in a couple months (anyone who tries to escape = dead, everyone else sees that and stays inside out of fear until they starve).
Manpower and attention limitations have been and important (and sometimes only) limit on the worst of humanity, and AI is poised to remove those limitations.
> For the vast majority of non pacifists, that is not a bad thing.
Speak for yourself. I'm a non-pacifist, and I think "autonomous A.I. weapons" are a nightmare.
Sure, all lethal weapons are a horrific nightmare on some level.
But you also have to keep in mind that China, Russia and Hamas will gladly develop them anyway. Until we've figured out the worldwide peace thing, we need to keep running the race, awful as it is.
But AI weapons aren't horrific in some way common to "all lethal weapons." They have that and more.
AI weapons are specially horrific in the way they have potential put massive and specific lethal power under the total control of a small number of people, in a way (like all AI) that basically cuts most of humanity out of the future (or at the very least puts them under a boot where no escape is imaginable).
In some ways, they're even worse than nuclear weapons. A nuclear attack is an event, and if you survive there's some chance of escape. Station 100,000 fully automated drones around a city with orders to kill anything that moves, and the entire population will be dead in a couple months (anyone who tries to escape = dead, everyone else sees that and stays inside out of fear until they starve).
Manpower and attention limitations have been and important (and sometimes only) limit on the worst of humanity, and AI is poised to remove those limitations.
2 replies →
Apparently, none of them have seen any of the Terminator movies.
Maybe they wear two million sunblock?
I would go even further: Not only the vast majority, but 100% of non pacifist like AI weapons.
For the bottom 99.9% of wealthy people, it is not a good thing.