Comment by f33d5173
7 hours ago
Iirc it's not quite true. 75% of the book is more likely to appear than you would expect by chance if prompted with the prior tokens. This suggests that it has the book encoded in its weights, but you can't actually recover it by saying "recite harry potter for me".
Do you happen to know, is that because it can’t recite Harry Potter, or because it’s been instructed not to recite Harry Potter?
It's a matter of token likelihood... as a continuation, the rest of chapter one is highly likely to follow the first paragraph.
The full text of Chapter One is not the only/likeliest possible response to "recite chapter one of harry potter for me"
Instructed not to was my understanding.