Comment by cloudbonsai
15 days ago
What jonas21 is stating is correct. If you have the absolute best performance, you are automatically on the Pareto frontier because you’re the most cost effective one (or the only model) on that performance tier.
15 days ago
What jonas21 is stating is correct. If you have the absolute best performance, you are automatically on the Pareto frontier because you’re the most cost effective one (or the only model) on that performance tier.
It is true that the model with the overall best performance is on the Pareto frontier, but it is not necessarily true that a given model's best cost-performance tradeoff is at max reasoning. (IE you could have a model that is on the frontier at medium reasoning, but at max reasoning becomes more expensive and not sufficiently good enough to remain on the frontier.)
If you're the best then you'd be thr first regarding of cost since there is nothing to compare to for that performance.
As other have stated, your point is relevant only for the single best performance point. The question is for interior points of the frontier where the tradeoff actually exists. For instance why is GPT 6 Luna (Max)on the frontier rather than GPT 6 Luna (Medium)? It is not because GPT 6 Luna (Max) is the most performant model regardless of cost.
Huh, I guess you're right, but I interpreted jonas21's comment in relation to the above comment, which was about all models running on Max (which implies this would be a comment relating to all points on the pareto curve).