Comment by layer8
1 day ago
It would actually be nice to have a book-LLM. That is, an LLM that embodies a single (human-written) book, like an interactive book. With a regular book, you can get stuck when the author didn’t think of some possible stumbling block, or thinks along slightly differently lines than the reader. An LLM could fill in the gaps, and elaborate on details when needed.
Of course, nowadays you can ask an LLM separately. But that isn’t the same as if it were an integrated feature, focused on (and limited to) the specific book.
I've not used it, but isn't this kind of what NotebookLM does?
You drag a source into it such as a books PDF and then you have a discussion with it.
https://notebooklm.google
What I’m imagining is an LLM that is strongly tied to the book, in the sense of being RLHF’d for the book (or something along those lines), like an author able to cater to any reader interested in the book, but also confined to what the book is about. An LLM embodiment and generalization of the book. Not an LLM you can talk about anything where you just happen to talk about some random book now. The LLM should be clearly specific to the book. LLMs for different books would feel as distinct from each other as the books do, and you couldn’t prompt-engineer the LLM to go out of the context the book.
This doesn’t make sense to me. Why would you want something like this? What is it exactly that you expect from such a finetuned model that you cannot get from a frontier general purpose model?
Tyler Cowen's GOAT book explores this in depth. Try it out! https://goatgreatesteconomistofalltime.ai/en
Genuinely have no idea what the novelty of this is for versus just uploading a PDF to ChatGPT. In terms of UX it is incredibly limited for a book evolution work.
Submitted for your amusement, my part in the downfall of the titanic book-shilling intellect that is EconGOAT GPT-4: