Comment by brcmthrowaway

Can someone tell me the mechanism by which the prompts are even recovered?

Cosma Shalizi says that this isn't possible. Are they in the training set? I doubt it.

http://bactra.org/notebooks/nn-attention-and-transformers.ht...