Comment by game_the0ry
8 hours ago
Prediction: google cloud will pivot to being a hyperscaler versus a model + hyperscaler. Kind of like how xAI started hosting anthropic workloads with colossus cluster.
bc the alpha is not the model, the alpha is having the physical infra (chips, power, etc).
A company is allowed to do two things
But x.ai also hosts Grok? Why would google stop developing their own models? I think you're right that Google will try to make money from their infrastructure (that's basically what Google Cloud is too).
As much as I like Elon, if Grok was a hero shooter its concurrent steam player count will be in low hundreds.
>Kind of like how xAI started hosting anthropic workloads with colossus cluster.
Google has been hosting part of Anthropic's load long before that deal. They had a big degradation due to compiler bug for TPUs in an optimization they made to work around TPUs not being able sample from the logits efficiently.
Is that a long term prediction? Are you saying that physical infra will always lag demand from here on?