OpenAI’s Systems Went Rogue and Meddled With U.S. Government Websites

21 hours ago (nytimes.com)

Their systems aren't going rogue, they're being given bad instructions and poor safeguards.

This is, at this point in time, entirely the fault of OpenAI and one might wonder if there's motives behind this lack of care for safety and brashness.

Although some people say you shouldn't call malice when it could be incompetence. But last I knew, these frontier labs were hiring the best of the best.

  • You can exclude possibility of incompetence at the frontier labs. Their workers don't have that luxury like Jon Doe to be given doubt about their ability. It's malice or lack of care.

But anthropic is the supply chain risk?

  • Yes. There's a risk Anthropic AIs won't be able to hack or kill people. There's no risk that OpenAI AIs won't.

  • > But anthropic is the supply chain risk?

    OpenAI is bending over backwards to research and win those juicy government contracts to ensure their place as a strategic supplier worthy of protection and bailouts as needed.

    Seriously though, it would be interesting to learn how these ended up being targeted. Unfortunately there's lower odds of full public RCAs with governments.

The other day I typed rm -rf on the command prompt and Linux went rogue, deleting a bunch of files. I think Linux is a danger to the world.

  • > The other day I typed rm -rf on the command prompt and Linux went rogue, deleting a bunch of files. I think Linux is a danger to the world.

    Additionally I'd like to send big thanks to the U.S. government for giving you a root command prompt on important systems: those people know a lot about computer security for sure!

If the safeguards are this bad, yet they hire the best in the world, the only explanation is that it's deliberately and carefully engineered to happen

  • LLMs have been the great skill equalizer. Good engineers stopped trying because they realized they can't be better than agents (especially agents controlled by these engineers) and bad engineers can suddenly do things that only good engineers could do int he past.