Comment by hamdingers
2 days ago
Correct me if I'm wrong, but I thought everyone was still doing inference on the GPU for Apple silicon.
2 days ago
Correct me if I'm wrong, but I thought everyone was still doing inference on the GPU for Apple silicon.
The Apple M series is SoC. The CPU, GPU, NPU, RAM are all part of the chip.
The RAM is not part of the SoC. It's a bunch of separate commodity RAM dies packaged alongside the SoC.