Comment by WhitneyLand

tldr: Seeing what happens internally in an LLM lets you reconstruct the original prompt exactly.

Maybe not surprising if you logged all internal activity, but it can be done from only a single snapshot of hidden activations from the standard forward pass.