Comment by sva_
1 day ago
I don't think the RAM size of the H800 was nerfed (80GB), but rather the memory bandwidth between gpus.
But yeah, would be interesting to see how they optimized for that.
1 day ago
I don't think the RAM size of the H800 was nerfed (80GB), but rather the memory bandwidth between gpus.
But yeah, would be interesting to see how they optimized for that.
Correct. There are 3 main ways to "gimp" high end GPUs meant for training - "cores", "on-chip memory speed" and "interconnects". IIUC the H800 had the first 2 unchanged but halved the interconnect speeds.
H20 is the next iteration of the "sanctions" that I believe also limited the "cores" but left the on-chip memory intact, or slightly higher (from the new generation).