Comment by lelanthran

> Comparing a 12 month period to a 6 month period feels unfair to me though.

Okay. Let me clarify then.

The difference between SOTA now and SOTA 6 months ago is a fraction of the difference between SOTA 6 months ago and SOTA 12 months ago.

That still "plateauing". The performance of the models, should you take the time to chart them, is clearly asymptotic and we're in the flattening out phase now.

I also observe that all the models are converging on roughly the same performance, which makes me think that we are approaching some maxima with the current approach.