Comment by samus 4 days ago It would make sense to repeat the experiment with the tokenizer of an LLM. 1 comment samus Reply sebastianmestre 4 days ago Pretty sure that OpenAI uses BPE in their GPT models
Pretty sure that OpenAI uses BPE in their GPT models