Comment by mike_hearn
7 hours ago
I think speculative decoding eliminates a lot of the savings people imagine they're getting from making LLMs use strange languages.
7 hours ago
I think speculative decoding eliminates a lot of the savings people imagine they're getting from making LLMs use strange languages.
No comments yet
Contribute on Hacker News ↗