Comment by dontlikeyoueith

5 months ago

> On the other hand this thing got 83% on a test I got 47% on

Easy to do when it can memorize the answers in its training data and didn't get drunk while reviewing the textbook (that last part might just be me).

The Olympiad questions are puzzles, so you can't memorise the answers. To do well you need to both remember the foundations and exercise reasoning. They are written to be slightly novel to test this and not the same every year.