Comment by monster_truck

4 hours ago

One thing you should have figured out by now is that you can't trust what other people say because they know just about as much as you do and there's good odds they did it wrong.

4 bit quants can be fine, try it and see.