Comment by nico

Anyone who has tried a smaller/quantized version locally on apple silicon? Would love to know your experience, also tk/s on what hardware specs?