← Back to context Comment by Fervicus 2 days ago It's better for VRAM poor people. I get 4-5 t/s with 27B and 20-30 t/s with 35B A3B. 1 comment Fervicus Reply dofm 2 days ago Also radically better on an M1 Max. I get well up into the 60s t/s with the A3B, stuck at 9.5 or so with this new 27B, though perhaps an MLX build will help.
dofm 2 days ago Also radically better on an M1 Max. I get well up into the 60s t/s with the A3B, stuck at 9.5 or so with this new 27B, though perhaps an MLX build will help.
Also radically better on an M1 Max. I get well up into the 60s t/s with the A3B, stuck at 9.5 or so with this new 27B, though perhaps an MLX build will help.