Comment by quotemstr
12 hours ago
> You don't get both. If LLMs don't require a lot of electricity, then why are we building so much more capacity?
A small number times a large number is often a large number. Have you heard of the concept called "per capita"? In any case, electricity is going towards data centers in proportion to the degree to which these data centers do useful work. AI companies buy the electricity fairly on an open market, sometimes even subsidizing this market by funding new generating capacity.
If all these people and companies are making electricity allocation decisions that make sense to them with their own money, who are you to stop in and say that their voluntary transactions are incorrect? Who died and made you the king?
Useful work is debatable here, a lot of people just talk to the thing or use it instead of searching the internet.
The owners surely think, or at least want us to think that it is very useful indeed, otherwise we'd see no point in burning through piles of investors cash to buy overpriced ram, storage, gpus, cpus, nics, secure the power to run it and then subsidise the users to use it.
I do think that transaction is wrong and it's going to bite them in the ass in the long term, but I don't have the money to outbid them for the power. I do get to see them crash and burn when the investors get impatient.
It’s new capacity!
They’re not even saying they shouldn’t do it or that they’re not useful or not worth it but you Cannot logically say both “these things do not use a lot of power” and “we need to build more power plants to handle these things”
Yeah you can, though to be fair its referred to as jevons paradox because it is counterintuitive.
I’m not saying it’s inefficient. I’m saying cloud computing uses a lot of power.
It isn't all new capacity. The popular discourse hardly ever mentions it but AI is a small fraction of why we need new datacenters and the bulk of the demand is driven by general IT needs, particularly consolidation of small, grossly wasteful corporate data racks into vastly more efficient cloud services.
Edited to answer: The question has also been addressed by the same author as the article: USA spent a quarter century not building generators and that negligence has finally caught up to us, despite objectively heroic efficiency efforts on the part of the IT sector.
https://hannahritchie.substack.com/p/usa-electricity-growth
If so, why do they need to build new power plants for it?
[flagged]
1 reply →