← Back to context

Comment by user43928

17 days ago

No one 'gave the program free rein' in any of those examples, did they? Reasonable safeguards were in place.

Many of these incidents relate to hacking, where criminal law commonly requires intent.

Claiming that a machine cannot make a decision does not mean an employee at OpenAI decided to hack an Australian government website.

Inadequate or broken safeguards do not fall under my definition of reasonable.

  • OK, but one of the examples in the source article was a report from third-party testing of those safeguards. I feel like you're starting from an unexplored presumption that adequate safeguards must be easy to build and anyone who doesn't build them is just being lazy.

    • Let’s go over their statement.

      > Inadequate or broken safeguards do not fall under my definition of reasonable.

      I see no such assumption there. In my reading, the implicit assumption is that adequate safeguards are necessary and that anyone who doesn’t build them is irresponsible. And I feel that that is correct.

      2 replies →

AI is irresponsible technology, because we have no idea how it works or how to contain it. It's worse than writing code that suffers from SQL injection vulnerabilities because at least in that case we know how to fix it.

The AI labs say "AI can make mistakes". That's why the responsibility of using it is on you. This may change if we get more legislation. But given the argument above, it will probably never shift to the AI itself having any responsibility. Instead the AI labs can be responsible.

  • "AI can make mistakes" continues to be the fundamental problem.

    It's like having an assistant that can be helpful, but not always. We can bicker about the ratio of helpful to unhelpful interactions, but there will be some unhelpful moments.

    And hoo boy, those can range from "eh, whatever" to being like a deranged toddler just got its hands on whatever tools and permissions were granted to the "mostly helpful" assistant.

    And we can't get rid of that chance. We can pare it down a bit. But we can't get rid of it because it is fundamental to how the technology works.

    • That's fundamental to how _any_ technology works. If the bar for use is "can never go wrong ever", then you need to throw away every human invention ever made.

      1 reply →