Comment by YeGoblynQueenne
18 hours ago
>> Internal OpenAI models are reportedly solving open problems at a surprisingly fast rate[2]
Maybe I'm failing to read that graph properly but the y axis says "pass rate" and it only goes up to 0.5. That would mean every single problem is at most half-solved.
I don't know what that means though. What is "0.5 pass rate" in the context of "open math problems" (as in the graph title)?
I guess it's a fraction of problems on which a model produces a LEAN proof or a counterexample.
Wouldn't they just list the number of problems solved then?
rates beat counts almost always.