Comment by xrd
14 hours ago
So if I'm reading this chart correctly, my 3090 card can get a 65-80% boost in speed generally? Or, is this only for certain models and quantizations?
14 hours ago
So if I'm reading this chart correctly, my 3090 card can get a 65-80% boost in speed generally? Or, is this only for certain models and quantizations?
25%-80%.
Certain (mostly AI) workloads. Depends on how hot you're comfortable running your card. The real-world improvement is considerably less due to other things being bottlenecks.