Comment by Nevermark

The problem becomes simpler if you turn it around.

It is getting easier and easier to create questions/problems that humans can't answer at LLM speed.

Of course, that solves a complementary problem, not the original. But in terms of instances, by any definition, the demographics are quickly moving in one direction.