← Back to context Comment by nsvd2 18 hours ago I think it obviously will, what would be the benefit to spinning up more than one copy? 1 comment nsvd2 Reply wtallis 17 hours ago It should only need to load one copy of the weights, but each tab/site will need a separate context and KV cache.
wtallis 17 hours ago It should only need to load one copy of the weights, but each tab/site will need a separate context and KV cache.
It should only need to load one copy of the weights, but each tab/site will need a separate context and KV cache.