Comment by fooker
3 days ago
> It's not like CPUs are slow, in fact they're quite a bit faster than any single GPU thread.
This was overwhelmingly true ten years ago, not so much now.
Modern GPU threads are about 3Ghz, CPUs are still slightly faster in theory but the larger amounts of local fast memory makes GPU threads pretty competitive in practice.
Are you writing this from the future? The latest gen nvidia gpus sit at around 2-2.5 GHz and the latest gen amd cpus sit 4-5 GHz.
That matches my personal experience too, writing naive cuda code that doesn’t take advantage of parallelism is roughly half the speed of running it on cpu.