Comment by nmfisher
3 days ago
I suspect that generating textures directly in UV space is a bit of a dead end because UV maps are object-specific, so flux/SD/etc are going to have a hard time understanding the inputs.
I've been experimenting with image-to-image (and video-to-video) for basic texture projection, which I think shows promise:
https://bsky.app/profile/nickfisherau.bsky.social/post/3lqrl...
I just started diving into this today too:
https://github.com/YixunLiang/UniTEX
which works with in "volumetric space" (for lack of a better word), which I think makes a lot more sense.
It actually performs remarkably well with mask maps as Control Nets. You can use a simple black background and white UV shells, that will give you OK results. But then you expand and use curvature maps just like you would with line art control nets, and then you have a controlled painting.
Even simple black/white shells work well, like here: https://x.com/_hackmans_/status/1644811607799738371