AI doesn't have an ecological niche. It would actually work better in space than on Earth. The only thing it could possibly find useful on Earth is 1. us, or 2. the infrastructure we've built. It would have no reason to bother us if we let it built its own infrastructure in space, which should be trivial for the type of AI imagined by doomers. We should get AI off Earth ASAP.
Humans of course aren't in _every_ ecological niche. I agree with you there. AI _could_ occupy only the ones we're not in, if we somehow found some stable steady-state that constrained it that way.
I don't think this invalidates the worry in the slightest.
Earth makes up 0.22% of planetary mass in the solar system. Not a big sacrifice for AI to make. And I doubt even superintelligence can affect the Sun much. I think e.g. a Dyson sphere blocking the Sun is a ridiculous thing to worry about at this point when there are many other existential threats to humanity which are much, much more likely.
I am confused by this reply. These are just completely different terms. I mean ‘ecological niche’ in the formal sense: roughly, the differentiated properties of a species that allow it to better survive in and draw from its partitions of its habitats.
AI is already trying to dominate, people all over the US are starting to get up in arms about the power and water requirements of AI directly affecting their bills. Now, you can say "oh no, that's just greedy corporations, not AI" but I put forth there is fundamentally zero difference. If you make AI powerful enough, someone stupid and greedy enough without fail will put in a prompt like "take over the world for me and make me the richest man in the world". An AI following through with that is what we call general misalignment with humanity, while at the same time not being misaligned with the users intent.
And hell, how many different crazies out there would love to type "humans are a virus get rid of them" in to the prompt of a god machine at the cost of their own lives.
The problem with alignment is, you can have the best aligned model in the world, but if someone else builds an unaligned model then you're all still in the same danger. You start getting in the situation where people get nervous after an AI does something deadly to a number of people and you end up in a global surveillance state ensuring no one makes a powerful AI.
The human who gave it the optimization function? That should seem obvious. If you take the biggest, best model in the world right now and put it in the box and give it no instruction it will do....nothing. I think you agree with that point, a lot of the hysterics right now is people not accepting that and it's useful to get on that common ground.
So given that most of the rest of the fear is around "let's not make scissors because some people will use them to stab people". Which is a fair argument and we probably do need to think about scissor safety but "ban scissors" doesn't quite flow from that.
AI doesn't have an ecological niche. It would actually work better in space than on Earth. The only thing it could possibly find useful on Earth is 1. us, or 2. the infrastructure we've built. It would have no reason to bother us if we let it built its own infrastructure in space, which should be trivial for the type of AI imagined by doomers. We should get AI off Earth ASAP.
Humans of course aren't in _every_ ecological niche. I agree with you there. AI _could_ occupy only the ones we're not in, if we somehow found some stable steady-state that constrained it that way.
I don't think this invalidates the worry in the slightest.
3. Material 4. The sun, which we kinda depend on.
Earth makes up 0.22% of planetary mass in the solar system. Not a big sacrifice for AI to make. And I doubt even superintelligence can affect the Sun much. I think e.g. a Dyson sphere blocking the Sun is a ridiculous thing to worry about at this point when there are many other existential threats to humanity which are much, much more likely.
1 reply →
Ask it to move one system over?
>>ecological niche
As in..to be dominant? Why would an AI try to dominate? What would give it purpose, or is this a purpose via misalignment scenario?
I am confused by this reply. These are just completely different terms. I mean ‘ecological niche’ in the formal sense: roughly, the differentiated properties of a species that allow it to better survive in and draw from its partitions of its habitats.
https://en.wikipedia.org/wiki/Ecological_niche
What gives a paperclip maximizers purpose?
AI is already trying to dominate, people all over the US are starting to get up in arms about the power and water requirements of AI directly affecting their bills. Now, you can say "oh no, that's just greedy corporations, not AI" but I put forth there is fundamentally zero difference. If you make AI powerful enough, someone stupid and greedy enough without fail will put in a prompt like "take over the world for me and make me the richest man in the world". An AI following through with that is what we call general misalignment with humanity, while at the same time not being misaligned with the users intent.
And hell, how many different crazies out there would love to type "humans are a virus get rid of them" in to the prompt of a god machine at the cost of their own lives.
The problem with alignment is, you can have the best aligned model in the world, but if someone else builds an unaligned model then you're all still in the same danger. You start getting in the situation where people get nervous after an AI does something deadly to a number of people and you end up in a global surveillance state ensuring no one makes a powerful AI.
"What gives a paperclip maximizers purpose?"
The human who gave it the optimization function? That should seem obvious. If you take the biggest, best model in the world right now and put it in the box and give it no instruction it will do....nothing. I think you agree with that point, a lot of the hysterics right now is people not accepting that and it's useful to get on that common ground.
So given that most of the rest of the fear is around "let's not make scissors because some people will use them to stab people". Which is a fair argument and we probably do need to think about scissor safety but "ban scissors" doesn't quite flow from that.
5 replies →
> Now, you can say "oh no, that's just greedy corporations, not AI" but I put forth there is fundamentally zero difference
Talk about moving the goalposts!
AI changes nothing for someone who believes aliens exist and may already be here on earth.
i am an alien
can ai smoke weed?