Comment by mirekrusin

1 year ago

Not letters, but tokens. Think that it's translating everything to/from Chinese.

How does that explain why the tokens for strawberry, melon and "Stellaberry" [1] are close to each other?

[1] Suggestion from chatgpt3.5 for new fruit name.

  • Illiterate humans can come up with new words like that too without being able to spell, LLMs are modeling language without precisely modeling spelling.