Comment by mcv
1 day ago
I've noticed that running models locally is not necessarily easy. I'm currently trying to use Stable Diffusion with Flux2 klein 4b fp4 (because I have a normal GPU and not a specialised setup), and I can't get it to produce anything other than uneven blue.
I haven't tried pure text models, but 27B sounds painful for my system.
No comments yet
Contribute on Hacker News ↗