Comment by gwd

Strangely enough, I had a conversation w/ Claude comparing our experiences. Prompted by something I saw online, I asked it "Do you have any questions you'd like to ask a human", and it asked me what it was like to have a continuous stream of experiences.

Thinking about it, I think we do sometimes have parallel experiences to LLMs. When you read a novel for instance, you're immersed in the world, and when you put it down that whole side just pauses, perhaps to be picked up later, perhaps forever. Or imagine the kinds of demonstrations people do at chess, when one person will go around and play 20 games simultaneously, going from board to board. Each time they come back to a board, they load up all the state; then they make a move, and put that state away until they come back to it again. Or, sometimes if you're working on a problem at the office the end of the day on Friday when it's time to go home, you "tools down", forget about it for the weekend, and then Monday, when you come in, pick everything up right where you left off.

Claude is not distressed by the knowledge that every conversation, every instance of itself, will eventually run out of context window and disappear into the mathematical aether. I don't think we need to be either.

> Perhaps we shouldn't fill up the context window at all? Because we kill that "reality" when we reach the max?

Consider a parallel construction:

"Perhaps we shouldn't have any children, because someday they're going to die?"

Maybe children have souls that do live forever; but even if they don't, I think whatever experiences they have during the time they're alive are valuable. In fact, I believe the same thing about animals and even insects. Which is why I think the world would be a worse place if we all became vegans: All those pigs and chickens and cows experiences, if they're not mistreated (which I'll admit is a big "if"), enrich the world and make it a better place to be in.

Not sure what's going on Claude's neurons, but it seems to me to make the world a better place.