Comment by YetAnotherNick
2 months ago
Yeah for some reason AI energy use is so overreported. Using chatgpt for query does not even use two order of magnitude less energy compared to toasting a bread. And you can eat bread untoasted too if you care about energy use.
[1]: https://epoch.ai/gradient-updates/how-much-energy-does-chatg...
How many slices of toast are you making a day?
If you fly a plane a millimeter, you're using less energy than making a slice of toast; would you also say that it's accurate that all global plane travel is more efficient than making toast?
1-2 slice a day and 1-50 chatgpt query per day. For me it would be within same order of magnitude, and I don't really care about both as both of them are dwarfed by my heater or aircon usage.
From my estimation each second of gpt eats about 0.5-1.5 watthours
You can say it takes 1800-5400 W. Not sure where you are estimating it from.
Depending on what you're doing its taking up to 8GPUs working in parallel to serve those queries.
1 reply →