Comment by max979

8 hours ago

That M4 Pro is probably a beast for quantised models. My M2 Pro handles 34B just barely; what speeds are you seeing?

0 comments