Comment by ktallett
1 day ago
Despite having consumed all of Wikipedia, it still can't accurately answer many questions so I don't think it's relevance or value has waned. AI has not got anywhere near becoming an encyclopedia and it never will whilst it can't say I don't know something (which Wikipedia can do) and filter the fact from the fiction, which Wikipedia does uses volunteers.
Doesn't AI essentially use the concept of volunteers as well with RLHF?
Good point, it's similar to some extent. Although clearly the quality of the work that the people doing RLHF on the major LLMs is rather low in comparison with those volunteering at Wikipedia.
There were no "good" volunteers qualifier used though. Obviously, some RLHF "volunteers" are better than others just like some used by Wiki are better than others. I wonder if there's edit battles between RLHF like we've seen on Wiki?