Comment by TZubiri

I think you can do whatever you want with your train set, what would be concerning is training with the test set.

I don't think overfitting is separate, the consequence of putting the benchmarks in your training set is not that you "cheat" by breaking some moral code, it's that it breaks the purpose of the benchmark and trains your model to be good at that benchmark only, instead of being generally useful.