Comment by whimsicalism 1 year ago ? theyre not special tokens really 2 comments whimsicalism Reply jebarker 1 year ago i'm not actually sure whether they're special tokens in the sense of being in the vocabulary whimsicalism 1 year ago <think> might be i think "wait" is tokenized like any other in the pretraining
jebarker 1 year ago i'm not actually sure whether they're special tokens in the sense of being in the vocabulary whimsicalism 1 year ago <think> might be i think "wait" is tokenized like any other in the pretraining
whimsicalism 1 year ago <think> might be i think "wait" is tokenized like any other in the pretraining
i'm not actually sure whether they're special tokens in the sense of being in the vocabulary
<think> might be i think "wait" is tokenized like any other in the pretraining