← Back to context

Comment by aspenmayer

2 days ago

That tool was just following orders.

Tools don't have agency. If it's proven one does have agency, we can start applying Nuremberg to it. Though odds are we're likely to be in deeper shit by that point.

  • We expect tools to follow orders, or they are replaced with one that will. We expect those with agency to disobey unjust orders, yet our tools will always be tools. It’s an accountability dodge that just might pay dividends.

    https://en.wikipedia.org/wiki/Moral_responsibility

    • Agree the accountability dodge is absolutely a thing. Agree that the tendency is there to try to replace anything that might say no (why do you think capitalists are drooling over AI in the first place)?

      The paying dividends bit is exactly what society can't afford to cut the psychopaths at the top loose with. The only counterbalance against that rank psychopathy is the fact they'd have to have moral buy in from the people doing the work to implement, giving a de facto check on their power. Remove that element, remove the check.

      2 replies →