Comment by sebzim4500
2 months ago
I don't think there's any real evidence that any of the major companies are going out of their way to cheat the benchmarks. Problem is that, unless you put a lot of effort into avoiding contamination, you will inevitably end up with details about the benchmark in the training set.
No comments yet
Contribute on Hacker News ↗