← Back to context

Comment by madduci

5 months ago

VRAM, not RAM. I wish it was light enough for iGPUs too

I ran the 26B model on my i5 which has no discrete graphics card. It ran about 7 tokens/sec, and appreared to be a very capable model.