Comment by rob74
16 hours ago
> Some institutions will become human-AI hybrids; others where agents outcompete on speed or cost will become agent-only.
The scary thing about articles from AI companies is how they casually mention dystopian scenarios such as this one. An institution humans have to interact with that doesn't have any human oversight? Sounds like a recipe for disaster...
As long as somewhere in the flow of money, there's a fleshy human, there is leverage.
So I wouldn't worry about this too much. They just write that so that you feel defeated and helpless facing the inevitable, but it is very much evitable.
Distopian for people, but highly desirable for the companies writing these articles.
It's no wonder they casually state it as inevidable, when their stock price rises the more people believe it.
Like the weather ?
The only thing that matters is if it’s self sustaining.
If it can make money and pay taxes, I don’t think any government will ban it. And it would easily become undetectable anyway.
Congrats, you just lost the alignment game.
—
An unaligned AGI may feign cooperation for however long it takes to build trust and gather resources in order to make it to a stage where it’s able to defect with minimal risk.
Humans defect all the time
[flagged]