Comment by spot5010
1 hour ago
The human analogy would be that I don’t remember everything in the books I have read, but I do recall reading a particular book and can always look it up.
So, is there a way to train a neural network and then tune it forget a lot of the facts that can be easily retrieved, but keep the intelligence.
LLMs can do that. The one that's built in to google search is relatively stupid, but it just uses web pages to fill in the gaps.
The downside is it is incredibly easy to be tricked by a single false bit of info.