Comment by Finnucane
8 days ago
That is the problem: they are digesting it. They are not creating a new kind of library, where you could say, show me the text of "How to Fix Your Ice Cream Problems". (An actual book I own) It is not being done for our future reference.
They are digesting it an incorporating into the weights. You won’t be able to get the exact page but you will (if the model is good) be able to get the knowledge out of it in a likely far more concise, relevant, and certainly more widely accessible than the book sitting on your shelf.
> You won’t be able to get the exact page
This is a grave problem.
> you will (if the model is good) be able to get the knowledge out of it
That doesn't help with books that aren't factual in nature. "Getting the knowledge" out of a novel makes no sense.
That's a fairly limited view of what books can be for.