Comment by mk_stjames
19 hours ago
I saw '1-bit' and my mind first went to 1-bit dithered B&W image generation, not 1-bit model weights....
and so now I'm wondering how cool /fast / compressed a diffusion image generator could be if the images it was trained on / space it worked in was limited to 1 bit (Floyd-Steinberg / Atkinson / your favorite algo here) dithered images.
Training would surely be pretty quick and probably fit onto one modern GPU.
I think you'd still be better off training in greyscale and dithering after the fact.
This was exactly where my mind went as well and I think there would be some really cool ideas to explore here