You say that but for like 2 years there was a guy on huggingface releasing quants as TheBloke. No identity no nothing except he likely had a grant or a university job that let him do it. Quants aren't the same as training but it was beyond 99% of people at the time (as you say this is)
Cant stand when you guys try and force something as impossible on the rest of us simply because you could never accomplish it.
Some of us might be rich, or get funding, or in the future it could be useful when training is cheaper.
Open source has benefits even if you can run yourself. You can read the code for understanding/insights. Other labs could replicate/build on it.
> Some of us might be rich
I sure wish I had a few 100M of disposable income to train a frontier model.
> or in the future it could be useful when training is cheaper.
I do not think that physics will allow hardware getting that much faster. But maybe we will have different, cheaper architectures by then.
You say that but for like 2 years there was a guy on huggingface releasing quants as TheBloke. No identity no nothing except he likely had a grant or a university job that let him do it. Quants aren't the same as training but it was beyond 99% of people at the time (as you say this is)
Cant stand when you guys try and force something as impossible on the rest of us simply because you could never accomplish it.
1 reply →
If you would tell people at the start of 20th century how much energy we consume, they may not believe you or think it is wasteful.
2 replies →
Maybe not now, but what about 10 years down the line?
Yes.
Yet, I couldn’t afford a PC to run the original Crysis when it came out, now the hardware isn’t an issue anymore