Comment by ein0p
2 days ago
What's funny is that if you're well-read in your field, all such bullshit is plainly apparent. You know what the good baseline is, for example, and you know why the author didn't choose it. You know the deficiencies of the benchmarks and see how they were exploited to juice the results. You know their approach is infeasible IRL and can clearly articulate why. Etc, etc. You folks aren't fooling anyone but fools. It's sort of like e.g. a lazy employee thinks their manager doesn't know they're slacking off like mad. As a former manager I can tell you - that is most certainly not the case, and there's no way to hide.
This was the major upside to taking a seminar class where we read papers and discuss them. The prof tried to highlight some of these points. Not just seeing the graphs that are there but also the graphs they could have added but didn't.