Comment by wtallis
17 hours ago
It should only need to load one copy of the weights, but each tab/site will need a separate context and KV cache.
17 hours ago
It should only need to load one copy of the weights, but each tab/site will need a separate context and KV cache.
No comments yet
Contribute on Hacker News ↗