← Back to context

Comment by trollbridge

3 hours ago

We’re using 6bit quants since we have 32GB cards.

Gemma QAT is an honourable mention.

0 comments

trollbridge

Reply

No comments yet

Contribute on Hacker News ↗