Comment by saagarjha
17 days ago
Pretty sure CUDA will limit your thread count to hardware constraints? You can’t just request a million threads.
17 days ago
Pretty sure CUDA will limit your thread count to hardware constraints? You can’t just request a million threads.
You can request up to 1024-2048 threads per block depending on the gpu; each SM can execute between 32 and 128 threads at a time! So you can have a lot more threads assigned to an SM than the SM can run at once
Right, ok. So you mean a handful of warps and not like a plethora of them for no reason.
Thread counts per block are limited to 1024 (unless I’ve missed and change and wikipedia is wrong), but total threads per kernel is 1024(2^32-1)65535*65535 ~= 2^74 threads
https://en.wikipedia.org/wiki/Thread_block_(CUDA_programming...
Yeah I’m talking about the limit per-block.