← Back to context Comment by WithinReason 13 hours ago As an example, Grok 4 took $388M to train 12 comments WithinReason Reply HPsquared 13 hours ago Compiling source code also takes computing resources, only the scale is different. It's a very close analogy: source code with training data, and compiled binaries with model weights.The weights are literally a binary blob. WithinReason 12 hours ago The weights are the modifiable representation. You modify them with gradient updates. HPsquared 12 hours ago They are a cooked stew; the ingredients have already been chopped and mixed together. You can add things, yes, but you can't inspect the ingredients. 3 replies → halJordan 12 hours ago I can also open broadcom's antenna firmware in any hex editor. Why are you arguing that makes it open source? 3 replies → inigyou 11 hours ago You can hand-patch a binary, too. croes 12 hours ago An open source Mac OS is still open source even if I can’t afford a Mac.
HPsquared 13 hours ago Compiling source code also takes computing resources, only the scale is different. It's a very close analogy: source code with training data, and compiled binaries with model weights.The weights are literally a binary blob. WithinReason 12 hours ago The weights are the modifiable representation. You modify them with gradient updates. HPsquared 12 hours ago They are a cooked stew; the ingredients have already been chopped and mixed together. You can add things, yes, but you can't inspect the ingredients. 3 replies → halJordan 12 hours ago I can also open broadcom's antenna firmware in any hex editor. Why are you arguing that makes it open source? 3 replies → inigyou 11 hours ago You can hand-patch a binary, too.
WithinReason 12 hours ago The weights are the modifiable representation. You modify them with gradient updates. HPsquared 12 hours ago They are a cooked stew; the ingredients have already been chopped and mixed together. You can add things, yes, but you can't inspect the ingredients. 3 replies → halJordan 12 hours ago I can also open broadcom's antenna firmware in any hex editor. Why are you arguing that makes it open source? 3 replies → inigyou 11 hours ago You can hand-patch a binary, too.
HPsquared 12 hours ago They are a cooked stew; the ingredients have already been chopped and mixed together. You can add things, yes, but you can't inspect the ingredients. 3 replies →
halJordan 12 hours ago I can also open broadcom's antenna firmware in any hex editor. Why are you arguing that makes it open source? 3 replies →
Compiling source code also takes computing resources, only the scale is different. It's a very close analogy: source code with training data, and compiled binaries with model weights.
The weights are literally a binary blob.
The weights are the modifiable representation. You modify them with gradient updates.
They are a cooked stew; the ingredients have already been chopped and mixed together. You can add things, yes, but you can't inspect the ingredients.
3 replies →
I can also open broadcom's antenna firmware in any hex editor. Why are you arguing that makes it open source?
3 replies →
You can hand-patch a binary, too.
An open source Mac OS is still open source even if I can’t afford a Mac.