Comment by SamBam

I would have thought the most relevant Borges story to LLMs would be Funes, the memorious.

Funes can remember everything perfectly, every detail that he has ever seen or heard in his life. However, he cannot really think or understand what he has seen, because understanding requires forgetting, it requires generalization.

LLM's can only think insofar as they need to generalize over their inputs. If it's just a memorizing parrot, that is not a good LLM.