Comment by NooneAtAll3
2 days ago
While running LLM on tiny device is awesome, I'm more impressed by whatever training has produced the weights
2 days ago
While running LLM on tiny device is awesome, I'm more impressed by whatever training has produced the weights
It's quite sad people collectively behave as if leaderboards have served their time.
In the small parameter regime there is no room for benchmaxxing, so instead of leaderboards becoming useless, their utility was merely reduced to establishing ever smaller models with similar performance on the benchmarks, forcing compression or redundancy to be recognized and eliminated at the modeling level.