Comment by kadoban

> But I am surprised that they were able to pack so much flops into 300W.

I'm not. When you're doing inference you typically reduce power limits anyway if you're optimizing for efficiency. Even if you don't, it doesn't spike to the max of the card.

My 3090 I power it down to 175W or so for single-digit reductions in performance for like, 60% of the wattage, something like that.