Comment by littlecranky67

This. I don't know why OpenAI, Anthropic and others have these high valuations. We have a temporary demand shock on hardware (GPUs, RAM, Storage) but the market dynamics will create more supply in the next years. Once everybody and their mother can get their hands on hardware, we will see tons of token-per-dollar inference services competing against each others. None of these providers will do any training, just hosting open-weights model. Why would anyone give OpenAI and Anthropic their subscription money then.

And we haven't even scratched the surface on highliy-specialized distillations. All those generall-purpose open-weight model will see distilled variations for their respective industry niches.