Comment by teravor

3 hours ago

    > You use the previous gen model to prepare datasets for the next model iteration.

you can also use a previous gen model to literally generate data for the next gen model. people used to believe that this is a bad idea but it turns out if you create a scaffold which sinks a lot of compute into generating and grading the data the quality turns out great.