Comment by nayroclade

For pre-training, yes. But for post-training you need high-quality labelled datasets for reinforcement learning. So far AI has been most successful in coding, because you can translate the usage into such datasets, and thus produce a virtuous cycle: More usage produces more data, which produces better models, which drives more usage.

The question is whether this same model can successfully be applied in disciplines like medicine, law, engineering, etc.