Well it depends on how you define worthless. For you as an individual to ascertain truth, it may be useless. To build up a bloated AI Enterprise stock value. For false consensus narrative scripting. Very valuable.
Benchmarks have been close to worthless since Nvidia cheated 3DMark benchmarks by adding benchmark detecting code to their drivers in the early 2000s [1].
That's a bit dramatic. One person cheating doesn't mean everybody is cheating. Cycling didn't become pointless after Lance Armstrong was caught doping. But it may be the tip of the iceberg and warrant a change in methodology or further investigation.
It’s essentially worthless for you, as a consumer of them. The best way to see which one works best is to give a bunch of them a try for your specific use case
Well it depends on how you define worthless. For you as an individual to ascertain truth, it may be useless. To build up a bloated AI Enterprise stock value. For false consensus narrative scripting. Very valuable.
Benchmarks have been close to worthless since Nvidia cheated 3DMark benchmarks by adding benchmark detecting code to their drivers in the early 2000s [1].
[1] https://www.eurogamer.net/news280503nvidia
That's a bit dramatic. One person cheating doesn't mean everybody is cheating. Cycling didn't become pointless after Lance Armstrong was caught doping. But it may be the tip of the iceberg and warrant a change in methodology or further investigation.
Were there like 20 or 30 other cycling cheaters that were caught alongside lance Armstrong?
1 reply →
NVIDIA isn’t the only one who’s been caught.
https://www.anandtech.com/show/15703/mobile-benchmark-cheati...
It’s essentially worthless for you, as a consumer of them. The best way to see which one works best is to give a bunch of them a try for your specific use case
Not if you have a private eval you use for your own use cases.