Comment by hypfer
1 day ago
Kinda cool but also entirely useless given the limited VRAM.
The readme oversells it by pretending it would be something actually usable, when instead it is a cool achievement to make it happen.
1 day ago
Kinda cool but also entirely useless given the limited VRAM.
The readme oversells it by pretending it would be something actually usable, when instead it is a cool achievement to make it happen.
A 20 tps Qwen3.8-27B at 2 bits quantization is limited but not useless. I've been putting one on "read this codebase and figure out XYZ" for me, where the typos are less consequential.
[flagged]