Comment by silverlake

I suppose the issue is that it's a multiplier for bad actors. It has become so much easier to generate plausible-looking code (or any number of things that would've previously required a knowledgeable human to make something that at least passes the sniff test, let's say legal documents as another example) and just overwhelm the limited bandwidth of good actors.

We have historically intervened socially (via state regulation, taboo, or censure) in areas where the likelihood of misbehavior was high or the result of misbehavior was severe enough.

For example: nuclear material possession or refinement; slavery; consumer-available systemic antibiotics; ozone-damaging coolants; dowries.

Proscriptions on those are imperfect and inconsistent worldwide, but still prevalent. Each of them is a thing which benefited many people but whose practice enabled massive harm due to human failures (like laziness).