Comment by Aerroon

And you can run quantized versions on old hardware! Like 10 year old hardware. You might only get 3 tokens/sec, but it works.