Comment by evertedsphere

i'm sure you know this but it's important not to understate the importance of the fact that there is no "prompt"

the notion of "turns" is a useful fiction on top of what remains, under all of the multimodality and chat uis and instruction tuning, a system for autocompleting tokens in a straight line

the abstraction will leak as long as the architecture of the thing makes it merely unlikely rather than impossible for it to leak