Comment by roxolotl

> Many of these same mistakes can be found in popular Stack Overflow answers, which is probably where Claude learnt them from too.

This is what keeps me up at night. Not that security holes will inevitably be introduced, or that the models will make mistakes, but that the knowledge and information we have as a society is basically going to get frozen in time to what was popular on the internet before LLMs.