Comment by AIPedant

I am still dismayed how quickly we gave up on including the pre-training data as a requirement for "open-source" LLMs.

As someone who thinks LLMs as akin to Lisp expert systems (but in natural language): is like including the C source code to your Lisp compiler, but claiming the Lisp applications are merely "data" and shouldn't be included.