Comment by sosodev

3 hours ago

I’ve been running it via llama-server with no issues. Running the latest Bartowski 6-bit quant

1 comment