Comment by anonym29
8 hours ago
How do you feel about open weight models, and fully open source models (all data, training scripts/recipies, and model weights all open source)?
8 hours ago
How do you feel about open weight models, and fully open source models (all data, training scripts/recipies, and model weights all open source)?
I'm not aware of any advanced models with full training data available, let alone available with paid licenses for the training data.
The process of training and using them is also not likely to be any better than commercial models. 23% of Ireland's power is going to data centers, spreading that among less efficient hardware in less efficient setups is unlikely to be better, unless the models are so bad nobody uses them.
And I'm also not aware of anyone working on these models trying to reduce the social damage they are going to do.
>I'm not aware of any models with full training data available, let alone available with full licensing.
Check out the OLMo family from the Allen Institute for AI: https://allenai.org/blog/olmo3
Also worth looking at EleutherAI, LLM360, SmolLM, Apertus. Apterus even respects opt-out notices in their collection of the dataset they distribute. KL3M from Kelvin Legal is even trained on a 100% copyright-free legal/governmental corpus.
>23% of Ireland's power is going to data centers
This isn't even a rounding error in terms of global energy usage. Besides, renewable energy is cheaper than non-renewable energy now. Energy demand itself directly drives the deployment of renewable energy. Needing more electricity in a capitalist country literally causes the energy mix to become more green over time.
>And I'm also not aware of anyone working on these models trying to reduce the social damage they are going to do.
Is it fair to account for the social damage without accounting for the social good, like the unprecedented democratization not just of mere information, but knowledge and understanding itself, around the world? Think about how many deaths will be avoided, how many billions or trillions of years of human life will be gained over time, all of the people that gain access to a personalized, individually tailored tutor for any subject on earth, all of the medical and legal advances, etc.
> Needing more electricity in a capitalist country literally causes the energy mix to become more green over time.
Perhaps true, but meaningless except as a vanity metric if fossil fuel usage rises as well.
> Check out the OLMo family from the Allen Institute for AI: https://allenai.org/blog/olmo3
Is this a joke of just blatant publicity for this Billionaire "philanthropist"? This olmo uses random data of totally infringing license database such a StackEdu (https://huggingface.co/datasets/HuggingFaceTB/stack-edu).
I took this first dataset from what olmo claim to use and check a random used data -> https://github.com/rodriguescarina/URI . Boom MIT licensed (where is the credit?), 0 opt-in for AI training as far as I see.
You're right, the usage in the USA is bigger.
https://www.eia.gov/todayinenergy/detail.php?id=67704
Across all cases, servers alone accounted for an estimated 7% of commercial sector electricity consumption in 2025. Data center server electricity use grows to 22%–33% of commercial building electricity use by 2050 across our cases.
Distributing that outside of special purpose, optimized data centers isn't going to bring that number down.
> Apterus even respects opt-out notices in their collection of the dataset they distribute.
Yeah. Uh. That's the bare minimum.