Comment by contrarian1234
1 day ago
This seems like the equivalent of a university designing an ICE car...
What does anyone get out of this when we have open weight models already ?
Are they going to do very innovative AI research that companies wouldn't dare try/fund? Seems unlikely ..
Is it a moonshot huge project that no single company could fund..? Not that either
If it's just a little fun to train the next generation of LLM researchers.. Then you might as well just make a small scale toy instead of using up a super computer center
Why do you think it's about money? IMO it's about much more than that, like independence and actual data freedom trough reproductive LLMs
This model will be one of the few open models where the training data is also open which makes it ideal for fine tuning.
That it will actually be open and reproducible?
Including how it was trained, what data was used, how training data was synthesized, how other models were used etc. All the stuff that is kept secret in case of llama, deepseek etc.
Super computers are being used daily for much toy-ier codes in research, be glad this at least interests the public and constitutes a foray of academia into new areas.