Comment by anu7df

9 hours ago

Cracks are starting to appear. Open Ai and Anthropic are publicly asking for slowdown in AI research. Translation: We see this technology not being any more useful than what it is now, no AGI is coming, and the first one to accept this and slow down the dollar burn rate will incur the wrath of the market. So let's say this big boogey man technology will end all life on earth and we all slow down together. Bonus points if we can lobby for this to be included in the national security bucket. Then US govt can bail us out. Yay!

If Nvidia is the bank, they should be starting to sweat a bit. It's not often companies ask for a voluntary slowdown.

> Cracks are starting to appear. Open Ai and Anthropic are publicly asking for slowdown in AI research. Translation: We see this technology not being any more useful than what it is now, no AGI is coming

Predicting a usefulness plateau is absolutely wild given how fast AI agents have been improving at writing code this year. I have doubts about AGI but I think you’re making assumptions and translating it wrong. These two companies have always been asking for a slowdown from their inception, that’s not a new thing. It’s part marketing hype, but they both do want regulation to step in and slow down the competition, not because they see a usefulness plateau, but the opposite - the usefulness is growing so fast that they want to remain in control, and they are scared that working hard and competing will not be enough. Anthropic has also said out loud they think their competition (not just OpenAI) is not being responsible and they want the regulation so they can be the responsible shepherd, as AI gets more and more useful.

It's always funny to me when they do the fear-propaganda, e.g. A statement like "There's a 10% chance that AI will destroy humanity in a decade". If a government were for the people, it can reasonably react with "Okay - if that's the case, you should shut down. And if not you will be arrested. Because if this is true, you're willingly building equivalent of a nuclear bomb."

  • It feels like there's should be some sort of "demonstrable intent to do harm" statute on the books for situations like this.

    If you have a genuinely-held belief that AI systems will end life on earth and you willfully continuing working on them anyway, then, like... you probably shouldn't be allowed to walk free in civil society anymore, right?

  • Yeah, I've worked in risk management and if a company said "what we're doing has a 10% chance of killing lots of people" it'd get shut down so fast it'd make your head spin

The frontier companies asking for regulation is somehow one of their less insane marketing ploy to date