Comment by jstanley

Yes. This is the crux. If a person operating a computer wants it to do some benign thing, but (accidentally) it does some terrible thing, are they equally guilty, or less guilty, compared to if they deliberately asked it to do the terrible thing?

To my mind, if the terrible thing was an accident, the person is less guilty. I'm surprised this is controversial.

You might say "well they ought to know that LLMs are too dangerous to use and they shouldn't use them". That's fine! There's a spectrum. We can have "negligence" in between "total accident" and "deliberate malice".