← Back to context

Comment by Dwedit

6 hours ago

I tried it on my 6GB GPU and got 0.67 tokens per second. Need more than 6GB to run it well.

0 comments

Dwedit

Reply

No comments yet

Contribute on Hacker News ↗