Comment by janalsncm
3 hours ago
Because I was specifically responding to your claim that Jev’s training recipe would give it better accuracy than others. It doesn’t have better accuracy than others. You could do as well or better by distilling qwen for example.
Jev is ranked higher than others on the overall benchmark due to speed and/or cost, not accuracy.
Well yeah, that’s the whole idea. If speed and cost don’t matter, you could use Astra.
Obviously it’s the speed and cost that make it compelling. The tradeoff is accuracy.
Enough to matter? Maybe, maybe not. It’s not like it’s way down the chart. It’s probably good enough for a lot of tasks.