Comment by msk-lywenn

6 months ago

With good quantization, I bet we can get it down to 8B and it will easily fit on consumer grade galaxy.

(Sorry, I had to, with all the AI flood, I really was about to skip this info after the first 3 characters)

Researchers discovered the black hole has been consuming AI VC money, at the rate of $50M per day, and so finally explaining why it is gotten so big.

With good quantization you can get 36GB down to 8GB. To get 36B down to 8B you need good pruning.

I had a bit of a pause trying to figure out if someone named a model „black hole” from that title.

Hype is strong.