Comment by jvvw
20 hours ago
I think intuition is hard to test in a way that feels 'fair'.
You can do it - I doubt you could have got a first when I was at Oxford just by learning and understanding the material, but you should probably have been able to get an upper second. The final part of every question virtually always involved insight, but you'd obviously then have to prove what that insight helped you understand.
If you give people questions like those, there is the risk of complaints about the university not having been taught the material for the exams I guess, or you might find that nobody can answer those harder intuition parts. Certainly most students at Oxford couldn't answer that many of them - you needed to answer about three 'final' parts out of about ten questions say in each three hour exam to get a first and perhaps about 20 percent of students got firsts?
An aside, but tests should be that difficult. Otherwise you aren’t getting any signal at the high end. Even in the face of grade inflation that signal can be translated into grad school recommendations (in the uk case, getting all 10 might even garner a “really not bad.”)