Comment by zby

I guess you can imagine an LLM that contains all information there is - but it would have to be at least as big as all information there is or it would have to hallucinate. And also you Not to mention that it seems that you would also require it to learn everything immediately. I don't see any realistic way to reach that goal.

To reach their potential LLMs need to know how to use external sources.

Update: After some more thinking - if you required it to know information about itself - then this would lead to some paradox - I am sure.