← Back to context

Comment by DrammBA

14 hours ago

> I’m running the same model on a 48GB MBP with a q4 quant and it’s pretty decent.

Context size?

0 comments

DrammBA

Reply

No comments yet

Contribute on Hacker News ↗