← Back to context

Comment by dingdingdang

5 hours ago

Have you done preliminary numbers on replacing tokenizer on, say, llama-server?

2 comments

dingdingdang

Reply

marcelroed 4 hours ago

Added numbers here: https://news.ycombinator.com/item?id=49015014

marcelroed 5 hours ago

Running the numbers now