Comment by piyh
5 hours ago
30B is useless on 24 gigs of ram as there's ~4 gigs of ram left for everything else even with unsloth quants
5 hours ago
30B is useless on 24 gigs of ram as there's ~4 gigs of ram left for everything else even with unsloth quants
No comments yet
Contribute on Hacker News ↗