Comment by mcv

1 day ago

I've noticed that running models locally is not necessarily easy. I'm currently trying to use Stable Diffusion with Flux2 klein 4b fp4 (because I have a normal GPU and not a specialised setup), and I can't get it to produce anything other than uneven blue.

I haven't tried pure text models, but 27B sounds painful for my system.