Comment by punnerud
23 days ago
How performant is the CUDA code in browser compared to standalone program?
Could we have PyTorch / ML training with CUDA through the browser performing ok?
23 days ago
How performant is the CUDA code in browser compared to standalone program?
Could we have PyTorch / ML training with CUDA through the browser performing ok?
Distributed large model training with web clients?
With 10Tb/s Internet, then sure!
Well the bigger issue is that even natively I doubt there is enough performance to train anything interesting.
WebGPU don't have access to most accelerators in GPU so it would be super slow compared to CUDNN version but pure CUDA would be only x times times faster.