Comment by Terr_

7 months ago

I'm underlining that "it's a story, not a conversation" is indeed the direction we need to think in when discussing these systems, where an additional step along that direction is "it's a document which humans can perceive as a story." That's the level on which we need to engage with the problem, asking what features of a document seem wrong to us and why it might have been iteratively constructed that way.

In the opposite direction, people (understandably) fall for the illusion, and start operating under the assumption that they are "talking to" some kind of persistent entity which is capable of having goals, beliefs, or personality traits. Voodoo debugging.