Comment by tovej
17 days ago
A world model can be used to learn something about the real system. I said synthesize because in the context that LLM's work in (using a corpus to generate sentences) that is what that would look like.
17 days ago
A world model can be used to learn something about the real system. I said synthesize because in the context that LLM's work in (using a corpus to generate sentences) that is what that would look like.
Why can’t an LLM run experiments to synthesize new facts?
That's not what synthesis is.
But that small semantic note aside, if an LLM is used to trigger other tools to find new facts, then those other tools are modeling the "world" or a particular domain. Alternatively you could say that the system as a whole, that the LLM is a part of, models the "world" or a particular domain.
Does it matter how the new fact is acquired?
If an LLM uses a calculator to come up with an answer, does it make it worse than a model that can inference the answer without using a tool?