Comment by km144

3 days ago

The real question is: Why are people designing benchmarks that, if a model is trained on them, it won't improve the performance of the model at any real-world tasks? Why would anyone care about such benchmarks?

People are like typewriter monkeys, if something is possible to make it'll eventually be made.