Comment by sigmar
8 hours ago
Personally, I don't see facebook joining the fray (of fable level models) particularly "needle moving" in the discussion of whether frontier LLMs will be commoditized. Facebook spent hundreds of billions and have better talent than most.
If you can spend your way to Frontier LLMs even if it's a few hundred Billion that means it's a commodity same as nuclear or electricity or telecom.
This is the entire point here, give it a couple years every nation on the planet with 20-40B in funding would have their own champions with post Fable level performance.
I feel like Grok/xAI or whatever they're calling it was Exhibit A in "it just takes money", although I'd also add "and the organizational willingness to build not buy".
> give it a couple years every nation on the planet with 20-40B
Was this sarcasm?
How many nations on earth have 20-40B for LLM training? At 40.2 B, Spain has the 15th largest military budget in the world. I doubt any nation will spend 40B on gradient descent.