Comment by noosphr
2 days ago
Chinese models most likely are distillations of frontier models with tricks for subpar hardware. If you want to be ahead of the us labs you need to spend billions for pretraining from scratch.
2 days ago
Chinese models most likely are distillations of frontier models with tricks for subpar hardware. If you want to be ahead of the us labs you need to spend billions for pretraining from scratch.
If that is the case, it means one thing only - US labs don't have moat whatsoever and their expectation to have trillion dollar valuation is just laughable.
The moat is the compute.
The compute for training, or for inference?
1 reply →