← Back to context

Comment by simonw

9 hours ago

Tried again with a different quant, UD-Q2_K_XL:

https://tools.simonwillison.net/markdown-svg-renderer#url=ht...

2 comments

simonw

Reply

simonw 36 minutes ago

... and once more with UD-IQ4_XS

https://tools.simonwillison.net/markdown-svg-renderer#url=ht...

potus_kushner 7 hours ago

the xhigh version looks amazingly good for a 2 bit quant.