Comment by trissi1996
6 days ago
You're just wrong.
Vibes are not a meaningful comparison.
You can't compare different quantizations(Q4_K_M & Q4_K_XL) and also use a temp of 0.7 and use that for any meaningful comparison.
All difference you notice could be either due to temp randomness or quantization differences even if the original weights are exactly the same.
Also these were likely sourced differently so the quantizers could've used different quantization importance matrizes or process.
The weights are the same, the weights are all that matters.
[flagged]