Comment by dwattttt

4 days ago

Are you proposing separating responsibility from the language used to talk about responsibility? That's novel.

It's not novel at all, we do it all the time. It's very common to say "program X did Y" without making the conversation about blame or responsibility. But when the program is an AI agent suddenly using it as a subject of a sentence and saying that "agents did X" becomes a sensitive topic for some people.

  • Air safety is known for its blameless reviews of failures, notably it is not known for responsibility-less reviews.

    • And we surely need this for AI as the swiss cheese zone is getting rather huge.

      My position, and the position of a large number in AI safety, is that you cannot build an intelligence that is both general and safe. The closer you get to generalized the more options the system has to do things that are wildly unsafe beyond human imagination.

      This puts the AI labs in a serious bind while holding a bag filled with billions of dollars of debt.

      Worse this puts governments in a multi-polar problem where even if the big public labs get shut down, black budget operations have a lot of free reign to make agentic digital weapons. Governments are not well known to take a lot of responsibility when their weapons cause damage unless they lose.