Comment by nextaccountic
2 days ago
> How do you derive that something is "below average" or "average" or "above average"?
One technique is RLHF: have an human expert assess it.
2 days ago
> How do you derive that something is "below average" or "average" or "above average"?
One technique is RLHF: have an human expert assess it.
Mhm, I just wonder how many samples they get and how much time they have to come to the conclusion.
Like a short example is easier to grade, but not in the same ballpark as a whole codebase.