Comment by timothyduong

Would matmul acceleration in m5 do much to improve token Generation? I’m planning to upgrade when the new studio updates to m5 but if it’s not much of a shift I’ll probably look at a second hand 256+ ram m3 studio.

Edit: of course the software would need to leverage the neural accelerators which is another variable if the software supports it in the first place