Comment by dist-epoch
9 hours ago
Each letter has it's own token. LLMs can invent new words if they want to, just like humans do. All the fancy words we use today in science did not exist even 100 years ago. And that didn't stop us.
9 hours ago
Each letter has it's own token. LLMs can invent new words if they want to, just like humans do. All the fancy words we use today in science did not exist even 100 years ago. And that didn't stop us.
How would this word inventing thing work? And how useful would it be? Can we make a POC around this?