← Back to context

Comment by pixl97

5 days ago

The post above yours shows how many people had a difficult time seeing past human scale. A bacteria has a very simple goal system yet bacteria have killed billions over the centuries.

You are right. We should also hold other threats to humanity: war, meteors, pandemics.

I'm obviously pointing out the (unsubstantiated) exceptional threat that we're all seemingly worried about: that ASI requires alignment because it'll otherwise cause the end of humanity.

  • I am much rather worried by powerful AI in control of a few corrupt beings. That might get existential, if one idiot one day by accident or intention gives them control over the nuclear arsenal. Or ruling literally with a iron fist (countless robots).

    • you guys are such flat thinkers, the whole "if we get SI we _win_."

      is a promisory threat to the world about a mass displacement labor bomb, nuclear first strike to disable asml and tsmc anthropic openai WHOEVER.

      how many countries have nukes?

      the cost of developing those is far lower than developing SI, it's a perceivable threat thanks to 'we win'.

      France, GB, Russia (good thing we've made a copromise to not protect allies huh), China.

      you don't wasn't to rehome these technologies do you?

      2 replies →