Comment by breckenedge
1 year ago
Since you’re releasing the code to GitHub, do you think you’ll eventually run into issues with the training data including prior versions of the game?
1 year ago
Since you’re releasing the code to GitHub, do you think you’ll eventually run into issues with the training data including prior versions of the game?
The implied scenario being that the memory of its own output would result in the model producing degraded future output? Why is that a given?
Probably the same reason that close relatives marrying each other for generations produces genetic problems.
Not the same reason at all. In genetics the reason is that you're losing gene variety and eventually recessive genes aren't suppressed anymore. In case of LLM it's just error accumulation.
8 replies →
Read about model collapse. The TL;DR is garbage in, garbage out.
https://en.wikipedia.org/wiki/Model_collapse