Comment by alexdrdr
6 hours ago
Have I been living under a rock, or this feels out of nowhere from Meta?
Seems they’ve just messed around with cheap and open weight models for years.
Then Muse appears, followed by full suite of frontier models…
6 hours ago
Have I been living under a rock, or this feels out of nowhere from Meta?
Seems they’ve just messed around with cheap and open weight models for years.
Then Muse appears, followed by full suite of frontier models…
they started their massive ai capex over a year ago with aquihiring scale ai, so I think it makes sense that their investment is paying off now. in total they've spent in the high 200 billion on ai, though I think most is likely on datacenters.
muse ai was the biggest consumer launch since chatgpt. That left them ( and lets them sit on top of ) tonnes of valuable exchanegs with people trying to get things done. That must be an amazing corpus for training.
Unlike everyone else, which at least has to pretend not to train on user data, they gave out their model for basically free if you agreed to let them train on it. Opencode shows nearly 40 trillion tokens going through muse spark 1.3 contributor this week alone. That almost definitely helped close the gap a lot.