← Back to context Comment by whimsicalism 5 months ago ? theyre not special tokens really 2 comments whimsicalism Reply jebarker 5 months ago i'm not actually sure whether they're special tokens in the sense of being in the vocabulary whimsicalism 5 months ago <think> might be i think "wait" is tokenized like any other in the pretraining
jebarker 5 months ago i'm not actually sure whether they're special tokens in the sense of being in the vocabulary whimsicalism 5 months ago <think> might be i think "wait" is tokenized like any other in the pretraining
whimsicalism 5 months ago <think> might be i think "wait" is tokenized like any other in the pretraining
i'm not actually sure whether they're special tokens in the sense of being in the vocabulary
<think> might be i think "wait" is tokenized like any other in the pretraining