Comment by eru

Thanks for the elaboration. (Though I'm not sure dmarinus would agree with your criterion?)

> For example, remove all code from your training data, and then see if the model can code regardless.

Would you accept this weaker version: make up a new programming language (that's guaranteed not to be in the training set), and see if the model (which has trained on programming in existing languages) can cope?