Comment by PittleyDunkin
1 year ago
What is a gestalt if not a token (or a token representing collections of other tokens)? It seems more reasonable (to me) to conclude that we have multiple contradictory tokenizers that we select from rather than to reject the concept entirely.
> That can't be tokenized
Oh ye of little imagination.
No comments yet
Contribute on Hacker News ↗