Comment by austinthetaco
24 days ago
Have you played around with any of the Hermes models? they are supposed to be one of the best at non-refusal while keeping sane.
24 days ago
Have you played around with any of the Hermes models? they are supposed to be one of the best at non-refusal while keeping sane.
Interesting! Unfortunately, the smallest Hermes 4 model I can see is 14B, which would really strain the limits of my little laptop. The only way I might get acceptable performance would be to run it extremely quantised, but then I probably wouldn't see much improvement over the 9B Qwen.