Comment by kadoban

The model they're running is Qwen 3.8 27b. It's maybe somewhere around Opus 4.6 level, it's quite good. I didn't check the benchmarks, that's from memory/vibes.

The ~issue is though that they're using a pretty low quant, 2 bit. 4 bit are _pretty_ close to full ability, maybe degraded a bit. 2 bit is _noticably_ worse. It's about as small of a quant as you can get while still pretending it works, for this model.

This won't replace claude for you, unless you baby it a lot and are okay with it being kind or derpy.