Comment by bitwize
6 years ago
Was there a lot of video game dialogue in the training text?
Palumpolum is a locale in Final Fantasy XIII, itself named after the characters Palum and Porom from Final Fantasy IV.
Shakuras is a locale in StarCraft, the planet to which the Protoss Dark Templar retreated after their schism with the Khalai of Aiur.
My model is bolted onto GPT-2 which is trained on internet text; I think some of these examples are coming from there.