← Back to context Comment by whimsicalism 3 months ago ? theyre not special tokens really 2 comments whimsicalism Reply jebarker 3 months ago i'm not actually sure whether they're special tokens in the sense of being in the vocabulary whimsicalism 3 months ago <think> might be i think "wait" is tokenized like any other in the pretraining
jebarker 3 months ago i'm not actually sure whether they're special tokens in the sense of being in the vocabulary whimsicalism 3 months ago <think> might be i think "wait" is tokenized like any other in the pretraining
whimsicalism 3 months ago <think> might be i think "wait" is tokenized like any other in the pretraining
i'm not actually sure whether they're special tokens in the sense of being in the vocabulary
<think> might be i think "wait" is tokenized like any other in the pretraining