Comment by robotnikman

>I run local LLMs infrequently, and every single prompt makes my beefy PC sounds like a jet engine taking off. It's a great reminder to not become codependent.

I would try setting the GPU to run at a lower power level. I set my GPU power level to 80% and it becomes much quieter, and only runs maybe 5% slower at most.

Also I 100% agree with the rest of your comment. We can only power the current growth we are seeing for so long.