Slacker News Slacker News logo featuring a lazy sloth with a folded newspaper hat
  • top
  • new
  • show
  • ask
  • jobs
Library

Comment by sothatsit

3 days ago

Inference costs falling 2x doesn’t decrease hardware prices when demand for tokens has increased 10x.

1 comment

sothatsit

Reply

PaulHoule  3 days ago

It's the ratio. If revenue goes up 10x you can afford 10x more hardware if you can afford to do it all.

Slacker News

Product

  • API Reference
  • Hacker News RSS
  • Source on GitHub

Community

  • Support Ukraine
  • Equal Justice Initiative
  • GiveWell Charities