Comment by rpdillon
7 hours ago
If I recall correctly, Strix Halo gets about 450G/s. The M series processors get between 400 and 800G/s, and an actual NVIDIA card is like 5.5T/s. 113G/s is pretty slow for inference.
7 hours ago
If I recall correctly, Strix Halo gets about 450G/s. The M series processors get between 400 and 800G/s, and an actual NVIDIA card is like 5.5T/s. 113G/s is pretty slow for inference.
The CPU is for mobile phones. An Nvidia H200 has 4.8TB/s. An RTX 5090 has 1.8TB/s. Both use ~700W - not comparable with a phone.
Strix Halo is 256 GB/s.