Comment by simonw
1 year ago
Maintaining a fine-tuned model for every one of your users - even with techniques like LoRA - sounds complicated and expensive to me!
1 year ago
Maintaining a fine-tuned model for every one of your users - even with techniques like LoRA - sounds complicated and expensive to me!
It is, but it's also not that bad. A copy of the weights is X GB of cloud storage, which can be stored as a diff if it helps, and added compute time for loading a custom model and unloading for the next customer. It's not free, but it's an approachable cost for a premium service.