Comment by peri-cl
3 hours ago
This is what the runtime reports, at Q8:
total params memory size = 15645.19MB (VRAM 15645.19MB, RAM 0.00MB):
text_encoders 7669.77MB(VRAM),
diffusion_model 7331.05MB(VRAM),
vae 644.38MB(VRAM),
controlnet 0.00MB(N/A),
extensions 0.00MB(N/A)
That suggests that 16GB RAM will not be enough.
In fact, like it appears in the reports above, it is "7b" as in
> 7B parameters in its visual generation component
It seems they calibrated the size to fill a 16GB VRAM near the limit. RAM requirements will vary.