Comment by gitpusher

10 hours ago

Likewise curious to hear how it goes! 80B seems too big for a 5090, I'd be surprised if it runs well un-quantized.

0 comments