Comment by NekkoDroid

I personally run the Q6 quant on my RX 9070 XT (16GB VRAM). On r/LocalLlama there was a post recently as well, which talked about the degradation of different quants (for the 27B version)[0]

[0]: https://www.reddit.com/r/LocalLLaMA/comments/1vef79c/quantiz...