Comment by mchusma
3 days ago
This is a solid release (at the intro pricing, the other pricing is dumb). I do think its a missed opportunity to really blow things out of the water and have this be another 1/2 off, but clearly they don't have the inference efficiency for it. Speed is good, the knowledge in google's models is solid for those usecases, price is reasonable (after 3.5/3.6 major missteps).
The intelligence index vs cost pareto frontier is crazy now, its basically a flat line with 9 people all at or right at the edge of the frontier along various parts of the graphs. Insanely competitive right now.
Probably golden age for competition before consolidation.
Maybe? But GLM just put itself on the pareto today again, so its up to 10. The theory was that there would be recursive self improvement in models, leading to a 1 or a handful of entities running away from the rest. But basically the opposite happened? Different teams, different hardware stacks. What do we make of this? (1) There must not really be any deep secrets/moats right now? (2) improving models is not something you can throw only intelligence at now?