Comment by Al-Khwarizmi
7 years ago
Just to set this straight... this is just GPT-2 fine-tuned on text adventures and taking your input? No world model at all? No logic at all beyond raw GPT-2 and the initial few lines that set a course for the story?
This is absolutely impressive. Yeah, of course there are incoherences in the generated stories. Keeping full coherence together with the current open-endedness would be quite close to AGI.
It does have surprising coherence, for example in one story I said that I was looking for a given object (that I made up) and then all the story revolved around that object and my search for it. Quite amazing.
I do a small amount of editing the text that goes in and out of the model (saving the last 8-10 actions and results, cutting off hanging sentences, adding "You " to the beginning of actions" but the only world model is the actions and text that's been generated, nothing else.