Comment by danielhanchen

6 months ago

I'm working on sub 165GB ones!

165GB will need a 24GB GPU + 141GB of RAM for reasonably fast inference or a Mac