Comment by CSMastermind

No, Erdos problems were accepted as sort of a benchmark. There's a bunch of reasons they're favorable for this task:

1. They have a wide range of difficulties. 2. They were curated (Erdos didn't know at first glance how to solve them). 3. Humans already took the time to organize, formally state, add metadata to them. 4. There's a lot of them.

If you go around looking for a mathematics benchmark it's hard to do better than that.