Comment by WithinReason
12 hours ago
Already beat Luna on price/task, by about 2x:
https://artificialanalysis.ai/models/deepseek-v4-flash?intel...
12 hours ago
Already beat Luna on price/task, by about 2x:
https://artificialanalysis.ai/models/deepseek-v4-flash?intel...
If only they would let you opt out of training use, it might actually be a viable option.
The training use is probably responsible for this improvement tho.
They could certainly still achieve that even if they had a slightly more expensive tier with a (pinky promise) "no training" bit set, or even if it were just an opt-in most users wouldn't bother with.
Maybe I'm reading that incorrectly, but it seems to me the cost is on the X-axis.
First, your direct comparison, Deepseek V4 Flash 0731 (max effort) $0.03 (rounded up) per task @ index 50.
OpenAI Luna:
* high effort $0.03 (rounded down) @ index 46
* xhigh effort $0.04 @ index 49
* max effort $0.07 @ index 51
So I would say a fair statement would be "OpenAI Luna between 2x and 3x the price of Deepseek Flash, what you get is 2 to 5 times faster inference"
The cheapest OpenAI model that beats it is OpenAI Luna (max effort) $0.07 @ index 51 (if you take the rounding out it summarizes to triple the price for similar performance), but still close to 3x faster.
And can SOMEONE please tell artificialanalysis that using dark blue for both Deepseek AND OpenAI is an especially unfortunate choice of colors, especially today?
For anything substantial, you'd want a bigger model anyway.
For simple tasks, they're already saturated, and you'd prefer the faster model, so that you can have a realtime/interactive-ish experience.
Or to put it bluntly, it's cheaper if you don't value your time. That goes for smaller models in general -- need more handholding, more correcting -- but the Chinese ones are slower on top of that.
As for speed, Sol on Low is faster than Luna on most settings.
>And can SOMEONE please tell artificialanalysis that using dark blue for both Deepseek AND OpenAI is an especially unfortunate choice of colors, especially today?
uhh openai is dark gray: `rgb(31, 31, 31)` and i'm pretty sure it always has been?
Came here to see how it performs against Luna. Would love to see how they compare on specific types of tasks.