Comment by phkahler

>> Going forward, however, I expect the inference market to grow much faster than training costs (and that includes the assumption that training costs will continue to skyrocket), which means they really can make it up in volume.

But as inference becomes cheaper, some of the market will move to self hosted inference. I look forward to someone supplying small servers designed to run inference locally.

With or even without open models these companies are selling compute, and we've been making that rent vs buy decision for 60 years.