Comment by ElProlactin

7 hours ago

> Regardless of whether you think they're right, most everyone at Anthropic is acting in good faith.

The road to hell is paved with good intentions.

Dario Amodei is a 40-something dude who is obviously very, very intelligent. But intelligence is not wisdom and his "essay" here can easily be read as someone who opened a can of worms and doesn't know (or can't accept) that he won't be able to put the worms back in. But he's going to try because he believes he owes it to humanity to try.

It's hubris in its most basic form, even if the guy who has it looks nice and wears shawl-collar sweaters.

I see what you mean. I meant more that they genuinely believe the tech is dangerous, not that they are necessarily doing the right thing.

  • If they genuinely believe the tech is dangerous, how would it be acting in "good faith" to keep developing it, prepping an IPO, etc.?

    • They believe the tech is currently powerful and may become super super powerful very soon, and powerful tools can help us and can hurt us. Nuclear fission can provide so much energy to power our society and kill millions of beings.

      So, i think they're hopeful for the help and terrified of the harms and are maybe trying to slow down on the amplifier of those effects for now.

    • The entire essay is about stopping development until it can be made more safe, with specific ideas on how to do that.

      The fact that he would suggest this despite preparing for an IPO is an even stronger signal that it's in good faith -- it will almost certainly delay or reduce the valuation of the IPO.

      1 reply →