Comment by ben_w
2 years ago
A human-level AI can do anything that a human can do (modulo did you put it into a robot body, but lots of different groups are already doing that with current LLMs).
Therefore, please imagine the most amoral, power-hungry, successful sociopath you've ever heard of. Doesn't matter if you're thinking of a famous dictator, or a religious leader, or someone who never got in the news and you had the misfortune to meet in real life — in any case, that person is/was still a human, and a human-level AI can definitely also do all those things unless we find a way to make it not want to.
We don't know how to make an AI that definitely isn't that.
We also don't know how to make an AI that definitely won't help someone like that.
> We also don't know how to make an AI that definitely won't help someone like that.
"...offices in Palo Alto and Tel Aviv, where we have deep roots..."
Hopefully, SSI holds its own.
Anything except tasks that require having direct control of a physical body. Until fully functional androids are developed, there is a lot a human-level AI can't do.
I think there's usually a difference between human-level and super-intelligent in these conversations. You can reasonably assume (some day) a superintelligence is going to
1) understand how to improve itself & undertake novel research
2) understand how to deceive humans
3) understand how to undermine digital environments
If an entity with these three traits were sufficiently motivated, they could pose a material risk to humans, even without a physical body.
Deceiving a single human is pretty easy, but decieving the human super-organism is going to be hard.
Also, I don't believe in a singularity event where AI improves itself to godlike power. What's more likely is that the intelligence will plateau--I mean no software I have ever written effortlessly scaled from n=10 to n=10.000, and also humans understand how to improve themselves but they can't go beyond a certain threshold.
2 replies →
The hard part of androids is the AI, the hardware is already stronger and faster than our bones and muscles.
(On the optimistic side, it will be at least 5-10 years between a level 5 autonomy self-driving car and that same AI fitting into the power envelope of an android, and a human-level fully-general AI is definitely more complex than a human-level cars-only AI).
You might be right that the AI is more difficult, but I disagree on the androids being dangerous.
There are physical limitations to androids that imo make it very difficult that they could be seriously dangerous, let alone invincible, no matter how intelligent: - power (boston dynamics battery lasts how long?), an android has to plug in at some point no matter what - dexterity, or in general agency in real world, seems we’re still a long way from this in the context of a general purpose android
General purpose superhuman robot seems really really difficult.
2 replies →
> the hardware is already stronger and faster than our bones and muscles.
For 30 minutes until the batteries run down, or for 5 years until the parts wear out.
1 reply →
All you need is Internet access, deepfake video synthesis, and some cryptocurrency (which can in turn be used to buy credit cards and full identities off the dark web), and you have everything you need to lie, manipulate, and bribe an endless parade of desperate humans and profit-driven corporations into doing literally anything you'd do with a body.
(Including, gradually, building you a body — while maintaining OPSEC and compartmentalization so nobody even realizes the body is "for" an AI to use until it's too late.)
> (Including, gradually, building you a body — while maintaining OPSEC and compartmentalization so nobody even realizes the body is "for" an AI to use until it's too late.)
It could, but I don't think any such thing needs to bother with being sneaky. Here's five different product demos from five different companies that are all actively trying to show off how good their robot-and-AI combination is:
* https://www.youtube.com/watch?v=Sq1QZB5baNw
* https://www.youtube.com/watch?v=OtpCyjQDW0w
* https://www.youtube.com/watch?v=XpBWxLg-3bI
* https://www.youtube.com/watch?v=xD7hAbBJst8
* https://www.youtube.com/watch?v=GzX1qOIO1bE
2 replies →
Human level AI should be able to control an android body to the same extent as a human can. Otherwise it is not AGI.
> power-hungry
That has nothing to do with intelligence.
That's why it's a problem.
An AI can be anywhere on that axis, and we don't really know what we're doing in order to prevent it being as I have described.