Comment by selcuka

Ignoring the training costs, the marginal cost for inference is pretty low for providers. They are estimated to break even or better with their $20/month subscriptions.

That being said, they can't stop launching new models, so training is not a one time task. Therefore one might argue that it is part of the marginal cost.