Comment by 21asdffdsa12
1 day ago
First the tabs came for the RAM and i did not protest, for i had plenty. Then they came for the chip and i did not protest, for it was dark silcon anyway. Then they came for the HDD.
1 day ago
First the tabs came for the RAM and i did not protest, for i had plenty. Then they came for the chip and i did not protest, for it was dark silcon anyway. Then they came for the HDD.
And then they made the ram and ssd so expensive :)
I am curious if it reuses the LLM across all tabs, hard to imagine most machines can boot up 1-2 of any 4gb model unless its a more powerful system.
I think it obviously will, what would be the benefit to spinning up more than one copy?
It should only need to load one copy of the weights, but each tab/site will need a separate context and KV cache.
Okay, but the browser is basically the computer for most people.
Told ya.