Comment by joakleaf

2 months ago

Related and test on MacBook Pro M5 vs M4:

https://machinelearning.apple.com/research/exploring-llms-ml...

"Exploring LLMs with MLX and the Neural Accelerators in the M5 GPU"

1 comment

joakleaf

Reply
seanmcdirmid  2 months ago

Note this is the M5, not even the M5 Pro and definitely not the M5 Max or M5 Ultra. If they are getting these improvements on low end M series, I’m sort of interested in what happens with the M5 max when it’s ready (I. Not holding out hope that the M5 ultra will be done anytime soon).