Comment by Sol-

Seems like a very bad precedent if that were to become the legal interpretation. I can understand if there were requirements for AI companies to document their efforts to reduce harms in their model reports, but ultimately this is a general intelligence (to which degree you can debate) and it's part of its purpose and utility to be able to converse naturally.

Of course it should steer people away from harmful thoughts like any sensible human would, but that's all you can do, really.