Comment by Havoc
9 hours ago
You can also try speculative decoding with the E2B model. Under some conditions it can result in a decent speed up
9 hours ago
You can also try speculative decoding with the E2B model. Under some conditions it can result in a decent speed up
No comments yet
Contribute on Hacker News ↗