Comment by sosodev
3 hours ago
If you only care about facts, maybe. Even then I'm sure there are countless facts not described outside of old books.
I have a hard time believing that text valuable to humans would not be valuable to AI.
3 hours ago
If you only care about facts, maybe. Even then I'm sure there are countless facts not described outside of old books.
I have a hard time believing that text valuable to humans would not be valuable to AI.
Agreed, in addition LLMs are trained on a lot of useless data, such as the whole Reddit dataset which has to be at least 90% Reddit garbage, and that doesn’t seem to be a problem. I don’t see why ai labs wouldn’t want to also train on older data