Comment by willmadden
2 days ago
Were you using the full model or a quantized version, and what harness/configuration were you using?
It sounds like you were using a quant model.
2 days ago
Were you using the full model or a quantized version, and what harness/configuration were you using?
It sounds like you were using a quant model.
No comments yet
Contribute on Hacker News ↗