Comment by seanmcdirmid

1 day ago

What sort of M5 are you running? A max? MacMini's don't offer max CPUs.

M5 Max. But I also have a MacMini M4 Pro 64GB. Qwen3.6 runs on the M4 just fine - sure the M5 is at least 2x the speed. If Apple launches a MacMini with an M5, I will be the 1st one to get it.

  • You're only going to get an incremental improvement with an M5 Pro mini compared to an M4 Pro mini. Memory bandwidth goes from 273GB/s to 307GB/s, about 12.5% improvement for LLMs.

    • M5's have the neural accelarator that boosts prefill speed a lot. But token generation itself will not change that much, that's true.