Comment by zamalek
2 days ago
> with AI-generated content excluded from pre-training.
Though this is largely impossible these days, unless they pre-trained on pre-AI era data.
2 days ago
> with AI-generated content excluded from pre-training.
Though this is largely impossible these days, unless they pre-trained on pre-AI era data.
That could be. Just use pre-training for language understanding and let the post-training on synthetic data do the heavy lifting.