Comment by Dylan16807
3 years ago
> They overturned previous scaling laws
Can you link to a comparison or graph of obsolete and new scaling laws?
3 years ago
> They overturned previous scaling laws
Can you link to a comparison or graph of obsolete and new scaling laws?
The ones I had in mind were the newer 'Chinchilla' scaling laws (https://arxiv.org/pdf/2203.15556.pdf) vs. the older 'Kaplan' scaling laws (https://arxiv.org/pdf/2001.08361.pdf)