Comment by arbuge

Besides that, there's the issue of efficiency.

Better quality training data might enable you to build a leaner more efficient model than is far cheaper to implement and run than the expensive model used to generate the data to train it.

See for example: https://twitter.com/SebastienBubeck/status/16713263696268533...