Comment by jwpapi
3 hours ago
In the chart they use "Pareto Line", which I think is wrong. Pareto is 20% effort leading to 80% results. Which could be interpreted as models costing 20% having 80% of peak intelligence, but that’s not what it looks like to me.
It looks like the "Frontier Line" to me, which is also often misinterpreted. frontier does not mean the best models. It means all models that are not strictly dominated, meaning in most cases: Not same price or cheaper and more intelligent.
I personally would like the word frontier to be used with more criterias: Open Weights, per use-case, etc etc. This would make model selection easier, but I understand it’s not an easy thing to do.
There are two (or more) concepts named after the same person:
- Pareto efficiency/Pareto curves: Basically the convex hull of points along the edge of a graph, indicating the best tradeoff between the axes. This is what the post is talking about.
- Pareto principle: this is the 80/20 rule you're talking about
No, Pareto refers to Pareto efficiency https://en.wikipedia.org/wiki/Pareto_efficiency
What you call "frontier line" is also called "Pareto frontier" https://en.wikipedia.org/wiki/Pareto_front
Your description of it is basically correct though
This is the Pareto Front [1], rather than the Pareto principle. It's the idea that anything that's more intelligent is more expensive and anything that's less expensive is less intelligent.
[1]: https://en.wikipedia.org/wiki/Pareto_front
"Pareto" is many things, but here it does indeed refer to the frontier: https://en.wikipedia.org/wiki/Pareto_front
Thank you guys. I learned something new.