← Back to context Comment by Havoc 10 hours ago How do you determine confidence levels? logprobs? 2 comments Havoc Reply colingauvin 9 hours ago I initially tried annotating everything three times, then judging the annotation with the same model. That failed predictably, so yeah just logprobs right now, judged on a hand-annotated dataset. Mostly correlated - ~80%. nghiemphucminh7 7 hours ago [flagged]
colingauvin 9 hours ago I initially tried annotating everything three times, then judging the annotation with the same model. That failed predictably, so yeah just logprobs right now, judged on a hand-annotated dataset. Mostly correlated - ~80%. nghiemphucminh7 7 hours ago [flagged]
I initially tried annotating everything three times, then judging the annotation with the same model. That failed predictably, so yeah just logprobs right now, judged on a hand-annotated dataset. Mostly correlated - ~80%.
[flagged]