Comment by danielhanchen

2 days ago

I'm working on sub 165GB ones!

165GB will need a 24GB GPU + 141GB of RAM for reasonably fast inference or a Mac