Comment by asp_hornet
2 months ago
It’s all a bit voodoo to me but wouldn't the entire original source code be in the training data also?
2 months ago
It’s all a bit voodoo to me but wouldn't the entire original source code be in the training data also?
Yes, and LLMs have been shown to store and be able to output their training data, so this is at best very sketchy
Thank you for the answer, I was curious if they could produce it all too from the weights.