Comment by kayashaolu2

AI benchmarks are usually focused on the model’s ability to make, build, or solve something while the critical part of most tasks in the real world is in the ability to catch whether there is a mistake. Until we have more benchmarks focused on the ability of a model to detect an error I think we’ll have this discrepancy.