Comment by Aeolun
8 hours ago
2.5x the scaling efficiency, so 4 times the price? What is happening here? Did the subsidies dry up with the discrepancy between chinese and US models?
8 hours ago
2.5x the scaling efficiency, so 4 times the price? What is happening here? Did the subsidies dry up with the discrepancy between chinese and US models?
Scaling efficiency simply means if you took the first small model and scaled it up to the big model it would take 2.5x the resources to run. Not the that larger model is going to be any cheaper.
Kind of like scaling your personal automobile to the weight of a semi, the semi is still going to be far more efficient in moving cargo, not that the semi will cost the same to operate as the original car.
It's also 2.8x parameter count (1T -> 2.8T), likely higher activation per token (50B?).