Comment by wolttam
2 months ago
Nobody here talking about what this represents for demand on these models, if these numbers aren’t made up.
One person using 600B tokens in a month. The most I’ve hit is around 500M tokens and I thought that was a huge amount.
We’re going to have some major compute shortages for a while
Jensen Huang was saying humanity is going to need 1000x the current energy production in the future. He might not be wrong.
Or more probably, he will be wrong. We really need to stop amplifying marketing statements like the bullshit Huang and Amodei tell all the time. There's no much thought behind them, just marketing and wishes.
Cui bono? Jensen Huang wants you to believe AI is a necessity and that we will need 1000x the energy because he gets even richer if you believe him. It isn't true, though.
and all that heat is going to go where?
500m tokens is easy... I'm burning about 2b a week.
Anyone can burn tokens. Using them for something useful is the hard part.
Im pretty confident its useful :p
The AI hype sometimes feels like that scene in Mr Robot where they have the CIO light a bag of money on fire :)