Comment by skohan
14 hours ago
I think hardware scarcity plays a part in inference margins. They would get squeezed super quickly if anyone who wanted could just build an inference cluster, but that's not currently the case.
14 hours ago
I think hardware scarcity plays a part in inference margins. They would get squeezed super quickly if anyone who wanted could just build an inference cluster, but that's not currently the case.
I would assume hardware production has been ramping up significantly and it's more of a temporary supply chain issue though. While it could last multiple years, that's certainly not long enough for the hyperscalers to get a return on investment. Obviously more complicated than this, but still... I'm not buying.
We're also starting to see efficiency gains, so we might meet halfway.
Maybe but there are huge blocks of capacity about to be energized or handed over and the payment clock starts ticking immediately.