Comment by tootie

I think you're right and I think it's why Google have taken their pedal off the metal for model releases to focus on integrations and tools. And why Microsoft have backed off from the OpenAI partnership to do the same. Anthropic and OpenAI are going to massively struggle to maintain their pace and reach profitability just selling commodity tokens.

Fine tunes are a possibility but I think it offers very little uplift for the vast majority of uses beyond just stuffing enough context.