Comment by Wowfunhappy

4 months ago

How much system memory do you have? Llama.cpp can split layers across cpu and gpu. Speeds will be slower of course but it's not unusable at all.

0 comments