Comment by Wowfunhappy
14 hours ago
But if the original data is the whole internet (and then some), what would that even look like? Would it be useful to anyone? Are individuals going to re-run the training?
14 hours ago
But if the original data is the whole internet (and then some), what would that even look like? Would it be useful to anyone? Are individuals going to re-run the training?
It would look like a very large hard drive and a whatever the form of the cheapest way to train a huge model would be.
Useful? I guess without a ton of the RL training sets it may be challenging.