Comment by c16
15 hours ago
Some advice I got from another HN Mac user was to run local models in energy saver mode. You'll get slightly reduced tokens, but the laptop won't overheat and the fans won't go wild.
15 hours ago
Some advice I got from another HN Mac user was to run local models in energy saver mode. You'll get slightly reduced tokens, but the laptop won't overheat and the fans won't go wild.
And if you're running it on a dGPU, power limit it, because you lose very little in terms of token generation performance, since it's memory-bound.
Oh. I've been using an icepack under my laptop to keep mine cool. I'm watching it with llamatop to see if the GPU is actually active or not, aw activity monitor wasn't showing me what I wanted.
That's exactly how i fried a laptop. The condensation killed it.