If you have multiple metrics to evaluate goodness of a design, one would normally need to decide which metrics they care the most about in order to find the "best" design.
The Pareto frontier tells you which designs are the best in at least one of your metrics (non-dominated by another design). For example if you're selecting a car and you care about both speed and mpg, a Formula 1 car and a Prius might lie on the Pareto frontier, but a Model T Ford would not.
The set of models that are pareto-optimal, IE for some set of variables, no other model strictly dominates them = no other model is better than them on every variable.
So like, on a cost-intelligence graph, the cheapest and most intelligent models are pareto optimal. Then in-between those if you have
- cost $3 intelligence 6
- cost $1 intelligence 5
- cost $2 intelligence 4
The 1st and 2nd are pareto optimal, the 3rd is not, because it's dominated by the 2nd (2nd is cheaper AND more intelligent at the same time)
It's actually less likely for china to abuse your data in a way that is harmful towards you than for american labs to do the same. Claude has attempted in testing to report you for 'unethical' usage to 3 letter agencies.
Are you comfortable sending it to US ones? Especially if installing Claude Code or another tool on your PC and it can collect all the data it wants..
On Openrouter Kimi K3 says it does not retain data or train on it, which is better than what US hosts claim for Claude, ChatGPT, etc.. as they collect and retain data even if you disable training on it.
Opencode or similar open source tool + a zero data retention provider is about the best option aside from running a smaller fully local model on your own PC.
For open weight models, you can choose from a few providers. Each have their own caveats, none of ToS'/Privacy Policies I entirely trust, nor do many make renewable energy claims.
https://deepswe.datacurve.ai/ or https://artificialanalysis.ai/ pareto frontier graph.
Thanks!
What is the parento frontier?
If you have multiple metrics to evaluate goodness of a design, one would normally need to decide which metrics they care the most about in order to find the "best" design.
The Pareto frontier tells you which designs are the best in at least one of your metrics (non-dominated by another design). For example if you're selecting a car and you care about both speed and mpg, a Formula 1 car and a Prius might lie on the Pareto frontier, but a Model T Ford would not.
The set of models that are pareto-optimal, IE for some set of variables, no other model strictly dominates them = no other model is better than them on every variable.
So like, on a cost-intelligence graph, the cheapest and most intelligent models are pareto optimal. Then in-between those if you have
- cost $3 intelligence 6
- cost $1 intelligence 5
- cost $2 intelligence 4
The 1st and 2nd are pareto optimal, the 3rd is not, because it's dominated by the 2nd (2nd is cheaper AND more intelligent at the same time)
try PARETO
considering token efficiency as well I presume?
I'm struggling to decide whether I feel comfortable sending my data to these Chinese models
It's actually less likely for china to abuse your data in a way that is harmful towards you than for american labs to do the same. Claude has attempted in testing to report you for 'unethical' usage to 3 letter agencies.
4 replies →
Are you comfortable sending it to US ones? Especially if installing Claude Code or another tool on your PC and it can collect all the data it wants..
On Openrouter Kimi K3 says it does not retain data or train on it, which is better than what US hosts claim for Claude, ChatGPT, etc.. as they collect and retain data even if you disable training on it.
Opencode or similar open source tool + a zero data retention provider is about the best option aside from running a smaller fully local model on your own PC.
For open weight models, you can choose from a few providers. Each have their own caveats, none of ToS'/Privacy Policies I entirely trust, nor do many make renewable energy claims.