← Back to context Comment by adastra22 10 hours ago 1B x 4096 = 4T scalars.That doesn't fit in anyone's video ram. 1 comment adastra22 Reply kingstnap 6 hours ago Well we have AI GPUs now so you could do it.Each MI325x has 256 GB of HBM. So you would need ~32 of em if it was 2 bytes per scalar.
kingstnap 6 hours ago Well we have AI GPUs now so you could do it.Each MI325x has 256 GB of HBM. So you would need ~32 of em if it was 2 bytes per scalar.
Well we have AI GPUs now so you could do it.
Each MI325x has 256 GB of HBM. So you would need ~32 of em if it was 2 bytes per scalar.