Comment by Gormo

This is exactly correct. I don't understand all of the arguments that attempt to special-case LLMs. LLMs are just a different way of giving instructions to a computer, and one that we know is based on stochastic models and therefore has a higher likelihood of malfunctioning than conventional software.

But an LLM behaving in unintended ways is functionally no different from a conventional program behaving in unintended ways due to bugs or design flaws.

I think the narratives that anthropomorphize AI are doing everyone a major disservice in leading some people to think that the standard rules and expectations somehow don't apply when it's involved. But it's still just software, and you're still responsible for the results of software that you deploy and operate.