Comment by Jtsummers
7 hours ago
> unbounded goals consuming unbounded resources
What resources are unbounded? There are limits to growth in the real world, how are these ASIs going to escape physical reality?
7 hours ago
> unbounded goals consuming unbounded resources
What resources are unbounded? There are limits to growth in the real world, how are these ASIs going to escape physical reality?
"Consuming unbounded resources" just means there is no limit to how many resources it could apply toward achieving its goal. As you correctly point out, the real world contains finite resources, which means any resources used to sustain life are wasted and unacceptable. Everything is a zero sum game when you think big enough.
What's your basis for assuming that ASI would need the same resources as biological life, or that it would be incapable of sharing the resources needed in common?
>What's your basis for assuming that ASI would need the same resources as biological life
It's all just matter and energy. When you're actually trying to maximize some value, even very inefficient resource use is better than completely wasting it by not using it at all.
>or that it would be incapable of sharing the resources needed in common?
You can't repurpose the atoms in a human body without killing it. And more pressingly, living humans can interfere with your plans, reducing your chance of success, while dead ones are harmless.
7 replies →