Comment by jcgrillo
3 hours ago
> as costs go down
Huh? Why would that happen? Indications are that costs will likely go up, especially if currently vendors are selling tokens at a loss.
3 hours ago
> as costs go down
Huh? Why would that happen? Indications are that costs will likely go up, especially if currently vendors are selling tokens at a loss.
The main operational expense of a million LLM tokens is pennies of electricity.
Even if you generously depreciate the GPU and other hardware, it’s hard to believe inference at scale in April 2026 isn’t highly profitable.