Comment by whimsicalism 2 years ago ? theyre not special tokens really 2 comments whimsicalism Reply jebarker 2 years ago i'm not actually sure whether they're special tokens in the sense of being in the vocabulary whimsicalism 2 years ago <think> might be i think "wait" is tokenized like any other in the pretraining
jebarker 2 years ago i'm not actually sure whether they're special tokens in the sense of being in the vocabulary whimsicalism 2 years ago <think> might be i think "wait" is tokenized like any other in the pretraining
whimsicalism 2 years ago <think> might be i think "wait" is tokenized like any other in the pretraining
i'm not actually sure whether they're special tokens in the sense of being in the vocabulary
<think> might be i think "wait" is tokenized like any other in the pretraining