Comment by dietr1ch
12 hours ago
> The training cost for a model is constant
Constant until the next release? The battle for the benchmark-winning model is driving cadence up, and this competition probably puts a higher cost on training and evaluation too.
Sure. By "constant" there I meant it doesn't change depending on the number of people who use the model.
I got that part, it's just that it overlooks the power consumption of the AI race.
I wish we reach the everything is equally bad phase so we can start enjoying the more constant cost of the entire craze to build your own model with more data than the rest.