Comment by _aavaa_

4 days ago

I disagree. The y-axis is some arbitrary intelligence score that we use as a proxy for performance on whatever our specific task happens to be. So it doesn't matter if a model is a 0, 1, or 20 along this axis, they are all useless for the tasks I want.

And as the complexity of your score increases, the cutoff goes up. We can quibble about where your personal cutoff is, but it aint 0.

Y-axis is between 0 and 100.

But even if it was between 0 and Inf+, it still gives you a wrong perspective, especially if you are not paying attention, on model capabilities.