Comment by scotty79

> The 2-bit quant fits on devices with 256GB of RAM, VRAM or unified memory.

Ouch. I wonder how it compares to Qwen 3.8 running with 4-bit quant on 10 times less VRAM.