Comment by pclmulqdq

The inference cost is also huge in energy terms, not just the training. Remember that Altman's company builds gigantic models.