Comment by WithinReason
14 hours ago
If they open sourced the training data and code but you had to train the network yourself, would that be open source?
14 hours ago
If they open sourced the training data and code but you had to train the network yourself, would that be open source?
Which some companies have done! Nvidia, I believe, among others.
Yes, obviously.
Even though none of us could actually afford to train it?
Some of us might be rich, or get funding, or in the future it could be useful when training is cheaper.
Open source has benefits even if you can run yourself. You can read the code for understanding/insights. Other labs could replicate/build on it.
6 replies →
Maybe not now, but what about 10 years down the line?
Yes.
Yet, I couldn’t afford a PC to run the original Crysis when it came out, now the hardware isn’t an issue anymore
As an example, Grok 4 took $388M to train
Compiling source code also takes computing resources, only the scale is different. It's a very close analogy: source code with training data, and compiled binaries with model weights.
The weights are literally a binary blob.
10 replies →
An open source Mac OS is still open source even if I can’t afford a Mac.
Yes