Comment by msk-lywenn
1 day ago
With good quantization, I bet we can get it down to 8B and it will easily fit on consumer grade galaxy.
(Sorry, I had to, with all the AI flood, I really was about to skip this info after the first 3 characters)
1 day ago
With good quantization, I bet we can get it down to 8B and it will easily fit on consumer grade galaxy.
(Sorry, I had to, with all the AI flood, I really was about to skip this info after the first 3 characters)
Don't be sorry, that was pretty good
They very rare great HN joke.
How true this is
With good quantization you can get 36GB down to 8GB. To get 36B down to 8B you need good pruning.
I had a bit of a pause trying to figure out if someone named a model „black hole” from that title.
Hype is strong.
thanks for brightening the day :)
So you're saying it might fit on the S26?
Researchers discovered the black hole has been consuming AI VC money, at the rate of $50M per day, and so finally explaining why it is gotten so big.
That sounds low...
Glad you wrote it, the title took me down the same path for a few seconds :-D
that's too good, haha
But can you make it talk dirty to me