Comment by seanmcdirmid

3 days ago

if you have 128 GB, you could use Qwen Flash Next at some reasonable quant, with the new SSD hack for only keeping some of the model resident in memory.

0 comments