Comment by leansensei

And if you're running it on a dGPU, power limit it, because you lose very little in terms of token generation performance, since it's memory-bound.