Comment by hypfer

4 hours ago

Question is how many of those experts one needs to keep in vram for a given workload.

I could imagine (though I might be _very_ wrong there) that for example coding does not live in all of them. Maybe 1/3? Do we have real numbers there?

So maybe one can get away without much performance penalty by doing some LRU stuff?

0 comments

hypfer

Reply