Comment by Madmallard

1 day ago

It's not going to wipe out humanity, why would it?

Just the quality of life is going to drop to zero for everyone that isn't asymptotically wealthy and vacuuming up all the assets because no one is stopping them from just deleting all traditions and conventions and legal systems we have in place.

>why would it?

You're like 40 or 50 years behind this argument, with many rather bulletproof arguments that have been created in the last 20 years.

There is no why. It doesn't have to have will. It doesn't have to have intent. It could be a stupid prompt from an idiot on a powerful system. It could be given a job that is poorly define. It could be told to make as many paperclips as possibly.

The why doesn't matter. The levels of power the system can act on does.

As a thpught experiment, consider that if only one person has all of the assets then those assets are not worth anything. Furthermore, as a lone person, they cannot prevent other people from using their assets without their permission.