Comment by sgc

Yes, I was not sufficiently thinking about copyright as an arbitrary legal construct that can be manipulated at will. I don't think output should have copyright, but I would presume the copyright should it ever exist would belong to the user and not the LLM creator, just like photoshop does not give adobe rights to user output. However much like there is no copyright, the uncertain output from an LLM should never directly create legal liability - the user prompt and intention should, and legal standards regarding recklessness and malice should apply. Otherwise it's a bit like blaming somebody for the output of a roulette wheel.

So I think I like the current decision which is more about presentation, dissemination, application, and claims than content, and there should of course be liability for LLM creators if they are not actively dealing with results like CP, violence, or many other illegal or dangerous things.