Comment by tgrowazay
1 month ago
> 2048 Nvidia B300 GPU
With average price of $6/hour that is $12,288/hour for whole cluster.
Times 33 days times 24 hours it comes out to be $9.7MM , assuming no discounts.
That leaves $10.3MM/6 months for salaries, which is 103 employees at $200k/year or 51 employee at $400k/year.
It would likely be something like $4.5/hour for this big cluster.
[1]: https://verda.com/products#B300
It mentions it took 4 models to get there, so would that mean there were additional runs (and other steps/overheads) which were part of the cost separate from just the salaries in that time?