Comment by Gormo

Even the data-center-grade models are less intensive than people think. We recently installed a heavy-duty AI server (Gaudi2 cluster with 768GB VRAM) to run larger models up to 400B parameters on, and at full load, its power draw is about equivalent to a consumer stove or clothes dryer.

If you're running thousands of those concentrated into a single data center, your aggregate power draw is going to be huge, but a single server is entirely reasonable for a small business, or even a home user, to operate.