Comment by fwn

11 hours ago

If we focus too much on the world domination fiction, we really might, in a moment of lapsed attention, end up plugging essential infrastructure into the public internet, hoping some dream of global alignment might save us.

That's like giving a gun to a monkey and hoping the monkey is trained well. ..a frontier monkey though.

You believe essential infrastructure is air-gapped from the public internet today?

  • No. And no alignment, guardrails or slowdowns will ever secure our insecure infrastructure. Bad infrastructure decisions are a risk independent from AI.

    The only way to secure infrastructure is to actually do the work needed to secure it. Our waste water treatment facility might not actually need to be able to tweet its status.

    Cybersecurity is such an important topic for a country, dreaming about global alignment just to avoid fixing insecure infrastructure cannot be serious.

    A Russian state backed hacker will not ask Dario for permission or argue with his LLM about ethics. That train departed long ago.

    • > Bad infrastructure decisions are a risk independent from AI.

      All decisions are made relative to their tradeoffs including costs and risks.

      "Water levels rising 100x beyond historical levels are not the problem. The dam's height is the problem!"

      All systems should be made infinitely secure and all dams should be made infinitely tall.