Comment by nurettin

I don't see how this hurts training unless you hurl all hallucinations back at the model.

Alpha zero used a similar approach where it trained against itself and that only made it better. I don't think collapse is real.