← Back to context

Comment by arendtio

4 hours ago

You assume that LLMs are just summations of knowledge, implying that they do not create new knowledge. I doubt that this is the case. I mean, it comes down to the definition of knowledge, but as soon as you run LLMs, they can produce knowledge that has not existed before, and from my perspective, this is more like what we call thinking than it is just a reproduction of existing knowledge.

Research seems to on balance point towards RLHF&RLVR merely increasing subjective sampling efficiency within the pretraining data.