Comment by tdy_err
1 year ago
The implied scenario being that the memory of its own output would result in the model producing degraded future output? Why is that a given?
1 year ago
The implied scenario being that the memory of its own output would result in the model producing degraded future output? Why is that a given?
Probably the same reason that close relatives marrying each other for generations produces genetic problems.
Not the same reason at all. In genetics the reason is that you're losing gene variety and eventually recessive genes aren't suppressed anymore. In case of LLM it's just error accumulation.
It's a few days late but "losing gene variety" isn't the cause. What happens is genetic errors compound and are more likely to be expressed. I.E. "error accumulation".
7 replies →
Read about model collapse. The TL;DR is garbage in, garbage out.
https://en.wikipedia.org/wiki/Model_collapse