Comment by swingandamiss
1 day ago
Why do you on HN want AI to slow down (mainly OpenAI and Anthropic from what I see in the comments)? What's the driving force behind your opinions on this?
1 day ago
Why do you on HN want AI to slow down (mainly OpenAI and Anthropic from what I see in the comments)? What's the driving force behind your opinions on this?
Humans not dying would be an excellent feature for the future to have. Not a hard requirement though, we'll see if there are some story points left in the sprint.
I've got bad news for you on the whole humans dying thing. Seems like actually literally everyone is going to die. Turns out that this has actually been happening for a really long time - possibly since day one - and we've got no idea how to fix it.
I keep reading about AI killing all humans but I have yet to see a practical scenario where that happens. Somehow everyone is scared of that but nobody can explain exactly how that would happen?
A lot of people have explained how that would happen, in excruciating detail. The reason why this wasn't a major part of the discourse is that most people (including myself) did not believe jumps in capabilities like those we have seen in the last few years were likely.
For a superintelligent AI trained with methods anywhere close to what we are doing now, killing all humans is the default outcome. I actually think researchers are downplaying the risks to make their arguments more normie-friendly.
https://www.thecompendium.ai/ai-catastrophe
https://www.lesswrong.com/posts/uMQ3cqWDPHhjtiesc/agi-ruin-a...
A book if you will: https://en.wikipedia.org/wiki/If_Anyone_Builds_It,_Everyone_...
More time to proceed more cautiously in building this entity that will be faster and more effective at steering outcomes in the world than any human or, soon after, the entirety of humans combined.
Do you want the Chinese to stop as well?
Of course
1 reply →
I don’t want to become one of the lucky to be alive in a human zoo or a human lab…
"The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible - but I hear the same people express fear. No other human activity poses this level of danger." - https://x.com/hilbertspaess/status/2097476196791709843#m
"Development of superhuman machine intelligence (SMI) is probably the greatest threat to the continued existence of humanity. There are other threats that I think are more certain to happen (for example, an engineered virus with a long incubation period and a high mortality rate) but are unlikely to destroy every human in the universe in the way that SMI could." - Sam Altman
"If Anyone Builds It, Everyone Dies": https://en.wikipedia.org/wiki/If_Anyone_Builds_It,_Everyone_...
So given that, do you want the Chinese to stop developing AI too?
[dead]