Comment by msp26
3 years ago
>A minor weakness with LoRAs is that you can only have one active at a time
Uh this isn't true at all, at least with auto1111.
3 years ago
>A minor weakness with LoRAs is that you can only have one active at a time
Uh this isn't true at all, at least with auto1111.
IIRC it does merging/weighting behind the scenes.
I'm pretty sure that it's just serially summing the network weights, which results in an accumulated offset to the self-attention layers of the transformer. It's not doing any kind of analysis of multiple networks prior to application to make them "play nice" together; it's just looping and summing.
https://github.com/AUTOMATIC1111/stable-diffusion-webui/blob...
Source for this?