Comment by annjose
2 hours ago
> Who is accountable for AI agents?
Obviously the person who built and deployed the agent (the claw in this case).
If we treat this as a hard question, we risk treating AI systems as people rather than tools. This is exactly what Armin warned about in his "clanker" post last week.
Why is that obvious? Why not the model provider(s)? That is what we do in other cases with product responsibility.
That feels like deciding to go after Jetbrains because someone used IntelliJ to write a harmful program.
Is there a distinction I’m missing?
Hypothetical: Could a model self worm an agent system?
Jetbrains itself doesn't really write any code, nor does it have any range on interpreting what you're asking it. You can't really say "Jetbrains, write an HTTP scraper". With an LLM you can say "write HTTP scraper" and the output of this command might be a HTTP scraper, it also might be a crypto wallet stealing worm.
This is why your simple view of liability falls apart. On most machines you can expect a particular set of actions to have a particular set of outputs. Most machines you can take apart and map what will occur. With an LLM you cannot know the output of a prompt until you run the prompt. In theory if you run the same prompt twice you'll get the same output, but even that is not a given. It behaves somewhat more like a human where you can give them a task to do, but if they do something illegal instead said human would take on the liability.
1 reply →
Is it? I don't think it is...
Is that? How're the lawsuits against gun manufacturers working out?
This is a specious argument. I have not studied the case law, but I would guess that the reasons why courts decide in favor of gun manufacturers generally don’t apply to AI. Becauee the guns in question are not able to autonomously shoot people, and because they generally work as advertised.
A more accurate analogy would be Tesla and Autopilot. And they are being held liable in courts. They are being held responsible for autonomous behaviors that are not fully under the control of the operator, and they are being held responsible for misleading operators about the capabilities of the product.
Boeing got in trouble for MCAS, with a comparable legal basis.