← Back to context

Comment by msk-lywenn

1 day ago

With good quantization, I bet we can get it down to 8B and it will easily fit on consumer grade galaxy.

(Sorry, I had to, with all the AI flood, I really was about to skip this info after the first 3 characters)

With good quantization you can get 36GB down to 8GB. To get 36B down to 8B you need good pruning.

I had a bit of a pause trying to figure out if someone named a model „black hole” from that title.

Hype is strong.

Researchers discovered the black hole has been consuming AI VC money, at the rate of $50M per day, and so finally explaining why it is gotten so big.