Comment by tootie

I think the recent Grok release and considering xAI was relatively late to the game shows that the only moat to training giant models is how many GPUs you can buy. ChatGPT was earth-shattering and it took less than two years for multiple credible competitors to match or exceed them. Making these models profitable is proving extremely difficult in the face of so much competition and such unsustainable expectations being set. Google seems to be most likely to sustain themselves through this melee. Them and the Chinese companies.