Comment by honr

The current compute they are buying is NOT state of the art (check this year's academic research on inference hardware). There is 10x-100x inference-per-watt improvements in existing prototypes (in the industry, not just academia). Not sure what I am talking about? Ask your friendly AI agent of choice, for the details.

Check out mythic.ai for one example.