Comment by anentropic
9 hours ago
Do any frameworks manage to use the neural engine cores for that?
Most stuff ends up running Metal -> GPU I thought
9 hours ago
Do any frameworks manage to use the neural engine cores for that?
Most stuff ends up running Metal -> GPU I thought
It's referring to the neural cores(for matrix mul) in the GPU itself, not the NPU.
https://creativestrategies.com/research/m5-apple-silicon-its...
https://github.com/maderix/ANE