Comment by edude03
21 hours ago
I've been watching a bunch of bycloud on YouTube recently, and although he's done a great job reviewing papers from the big AI labs, I feel like I'm missing something - how have all the labs seemingly made a model that's cheaper, faster AND has better performance? Historically `flash` variants (like codex spark as well) have been faster but perform worse
That’s how increasing performance works. You make a model 10x faster, then you make it think 2x as much.
Its cost is now 1/10th per token, and 1/5th per task.
Basically they have shitty hardware so they have to do a lot of optimization. Think of it like replacing an O(n) algorithm with O(log n).
Anthropic / Open AI think the best path is the most intelligent models deepseek is more focused on tok/$
[dead]