Comment by gradascent

Not only do they train on that data but they train ONLY on that data and don’t have to generalize to other domains. And the architectures themselves, including hyperparameters, loss function, etc are chosen and tuned specifically for the quirks of this domain. So this result doesn’t surprise me either.