Comment by chorsestudios

Attempting to solve & solving open math problems probably is a good benchmark for comparing models and gauging model progression. A lot of useful info is obtained like time needed to solve the problems, identifying when not to chase dead ends, thought processes & logic steps, etc.