Comment by com2kid

They are trained on public information from the Internet! Nothing they know is dangerous!

It is all public info. Freely auditing an intro chemistry course at any university will teach far more "dangerous" knowledge than anything an LLM refuses to say.

There is a case against automating attacks with LLMs, but that ship has already sailed as those protections are apparently trivial to work around.