Comment by girvo
2 months ago
I cannot bring myself to care about distillation, when these companies have built their empires on top of everyone else's stolen data, while at the same time telling the world they're out to replace us all.
2 months ago
I cannot bring myself to care about distillation, when these companies have built their empires on top of everyone else's stolen data, while at the same time telling the world they're out to replace us all.
Sure, AI progress comes to a halt then as everyone switches to the copycats that can't innovate, and the frontier companies are bled dry.
"frontier" as in the frontier of using everybody else's code, books, art of everyone else for a specific purpose that was never intended to, as in, not even open source projects ever imagined LLMs becoming a thing and their licenses reflected as much.
You have a very poor understanding of LLMs if you think that is the frontier today. Maybe in 2024 it was.
1 reply →
These companies don't get the chance to raise a trillion dollars, and you're laughing???
Poor babies.
Again, I don’t care about them.
it's not about the companies, what a myopic viewpoint
every delay to AGI results in deaths that AGI could have prevented. we are talking millions of deaths for, say, just a year's delay.
9 replies →
Qwen are the only guys doing real innovation. (LLM architectures and such.)
Everyone else is just gaming engagement metrics and benchmarks.
Amazing that people on HN can't distinguish between training a model on open source data vs distilling a model's outputs.
You must have some absolutely unhinged ideas about what "open source" means.