Comment by Lerc
20 hours ago
You are going to have to be more specific, because that reads like nonsense.
By what mechanism do you propose the model observed the test set?
20 hours ago
You are going to have to be more specific, because that reads like nonsense.
By what mechanism do you propose the model observed the test set?
>By what mechanism do you propose the model observed the test set..
By explicitly setting the model parameters.
What happens when a model is trained? We tweak the model parameters by some feed back.
In both cases, you affect the model parameters. Only the method is different. So both are eqvialent to "model observing the test set".
I still do no see any causal link from the test set. When was this observed, how and by whom?
Are you trying to say that the person who entered the parameters had access to the test set? I find it more likely that they encoded the generalising rule than observed every instance of its use.
>I find it more likely that they encoded the generalising rule..
Look, I am saying that during training the model ends up "learning" the generalising rule from training data, but here it was explicitly entered into it, with out any training.