Comment by Ey7NFZ3P0nzAe
4 hours ago
Hi,
If you ever get to writing a blog post about kv cache quantisation, i'm interested in quantising K differently than V
4 hours ago
Hi,
If you ever get to writing a blog post about kv cache quantisation, i'm interested in quantising K differently than V
No comments yet
Contribute on Hacker News ↗