Comment by anematode
8 days ago
> memorization of upstream fixes from training data
At least now we have up-to-date evidence on their laundering, and the fact that regurgitation absolutely still happens.
8 days ago
> memorization of upstream fixes from training data
At least now we have up-to-date evidence on their laundering, and the fact that regurgitation absolutely still happens.
It actually happens more with these large overparameterized models, because they have the capacity to memorize more than smaller models.