Comment by bravesoul2

Yes LLMs are a funny workload. They require high amounts if processing but are very bursty.

Therefore using your own bare metal is a low of expensive redundancy.

For the cloud provider they can utilise the GPU to make it pay. They can also subsidise it with VC money :)