Comment by hazrmard
1 day ago
Do I understand this right?
A light-weight speculative model adapts to usage, keeping the acceptance rate for the static heavy-weight model within acceptable bounds.
Do they adapt with LoRAs?
1 day ago
Do I understand this right?
A light-weight speculative model adapts to usage, keeping the acceptance rate for the static heavy-weight model within acceptable bounds.
Do they adapt with LoRAs?
No comments yet
Contribute on Hacker News ↗