Comment by dofm

I assume some of this is the escalating cost of training, indeed, and that being faster means abandoning efficiency.

But you’re right. I have often wondered why it is that such a small amount of extra compute (300MW) from SpaceX was entirely enough for them to uncap so many customers.

I think the (in-house) data centre burdens of ever-more complex models may be considerable, but I think the data centre businesses expecting to serve inference tasks are probably heading into a Chinese real estate bubble.