Comment by itkovian_
1 hour ago
Your just missing many things and so have an incorrect picture of the situation - k3 is not on par with fable or astra. Closed models remain far better than best open weights at least today. - compute is not just used for training, more and more is inf - even in training you don’t do one run, you do many. Final run is a small portion of total compute.
The world is extremely compute constrained currently, like extremely.
This is evidenced by the prices on every large-model capable device/node increasing significantly over the last year. Demand is far exceeding supply.