← Back to context Comment by bilekas 6 hours ago > H200 GPU with 1.5TB host memory,While yes it's one GPU.. It's not exactly a slim one. 4 comments bilekas Reply nekusar 6 hours ago When the comparison is again 128 H100's , yeah, this is a crazy good upgrade.And you can rent H100's and H200s for not that much per hour. jeremyjh 4 hours ago Yes but they are getting only 341 tok/s. A 2.5 trillion run would take over 200 years. p_stuart82 4 hours ago $2-4/hr always sounds cheap until you multiply by wall clock and reruns anshumankmr 6 hours ago >cries in RTX 3060
nekusar 6 hours ago When the comparison is again 128 H100's , yeah, this is a crazy good upgrade.And you can rent H100's and H200s for not that much per hour. jeremyjh 4 hours ago Yes but they are getting only 341 tok/s. A 2.5 trillion run would take over 200 years. p_stuart82 4 hours ago $2-4/hr always sounds cheap until you multiply by wall clock and reruns
jeremyjh 4 hours ago Yes but they are getting only 341 tok/s. A 2.5 trillion run would take over 200 years.
When the comparison is again 128 H100's , yeah, this is a crazy good upgrade.
And you can rent H100's and H200s for not that much per hour.
Yes but they are getting only 341 tok/s. A 2.5 trillion run would take over 200 years.
$2-4/hr always sounds cheap until you multiply by wall clock and reruns
>cries in RTX 3060