Comment by cyanydeez
15 hours ago
>The scaling laws hold that a language model grows more capable with more parameters and more training data.
Which is a choice, not a "law":
https://arxiv.org/abs/2510.13786
15 hours ago
>The scaling laws hold that a language model grows more capable with more parameters and more training data.
Which is a choice, not a "law":
https://arxiv.org/abs/2510.13786
I think this is partially true: scaling parameter size will always go asymptotic to 100% accuracy because 100% is the ceiling of that metric.
However 95% is still half the error rate of 90%, and 97.5% is half the error rate of that.
And when test time compute like reasoning and looping harnesses stack many inference acts with many tokens each, those seemingly small accuracy gains stack tremendously.
Error rates will never go to zero and as context grows ambiguities grow in reverse. So your arguement is great to some token...n but after that, it all unwinds.