Comment by palmotea

3 hours ago

> They have been warning about AI extinction risk for years, and AI progress has only been accelerating.

So, they're either liars or homicidally reckless.

Sean Goedecke has some good insights into where this "build faster to stop other models killing everyone" attitude comes from:

https://www.seangoedecke.com/they-really-do-think-ai-might-k...

It's well worth the read.

  • > Sean Goedecke has some good insights into where this "build faster to stop other models killing everyone" attitude comes from:

    I'm familiar with the existential risk thinking.

    The the flaw in that idea that they can avert disaster by building faster is they're likely just racing faster towards more plausible non-extinction disasters. Stuff like Capitalism x AGI totally crushing the economic prospects of nearly all people, AGI-powered totalitarianism, etc.

> either liars

They're CEOs of tech companies with insane valuations

> or homicidally reckless

They're CEOs of bleeding edge tech companies with huge capital and military applications

>So, they're either liars or homicidally reckless.

Yes!

Unfortunately if the frontier labs that care about safety stop or slow down unilaterally, that doesn’t make the problem go away. It makes it worse when labs that do not care at all about safety, or deny that it is even a problem, are leading the way. That’s why there’s needs to be some form of international regulation.

  • Incidentally this regulation won’t really touch the US providers - at least it sounds like that’s the plan if you listen to current US admin

    • We literally cannot touch them, as that would be the first domino to topple in our economy. There is too much money concentrated in this sector, and adverse regulation would create an investor shockwave that would send us into a full blown depression.

      Which ironically is also the outcome of letting these companies continue unchecked. If they produce AGI/ASI, our economy will go through an upheaval that leaves vast tracts of the population unemployed. This is their stated goal.

      We are damned if we do something, and damned if we don’t.

      1 reply →

    • The impression I get is that there is absolutely no coherent plan at all for any type of regulation us domestic or otherwise