Comment by deaux
4 hours ago
> In short: per-token charges currently cover maybe 1% of the total costs in this field
There are plenty of seemingly informed people saying the exact opposite, so that's a lot of confidence you're talking with. I have a hard time believing it when we know what open weights models cost to run. And sure, there's training costs, but again many say inference costs are already above training costs.
No comments yet
Contribute on Hacker News ↗