Comment by nkrisc
24 days ago
Why couldn’t an LLM accidentally spit out story beats if they plausibly follow from the context and the player’s input into the conversation?
24 days ago
Why couldn’t an LLM accidentally spit out story beats if they plausibly follow from the context and the player’s input into the conversation?
What "context"? If it's coming from the player's input, then the LLM isn't spoiling anything.
e.g. let's say an important character dies in your game but that hasn't happened yet in this point in the story. You're talking to some NPC. That NPC can't possibly spoil that that character is going to die because the developer wouldn't feed that in as context. The NPC doesn't "know" the character is going to die. You, as the player, might be able to convince the NPC that that will happen and it might respond accordingly, but it won't just randomly divulge that by accident.
Or worse, what if the story of the game was already part of the training data
Like a remake of a game
This one is a fair point... if all the characters have distinctive names then NPC can plausibly become aware that it is a character in that game and spoil things. I don't know how to stop that, short of training a clean model from scratch, but that seems a bit much for a game.