Comment by Almondsetat 2 days ago Since the 3060s would have to communicate constantly using pcie, I think I'd go with intel 2 comments Almondsetat Reply apitman 2 days ago Currently software is king when it comes to inference performance though. Almondsetat 2 days ago Having the entire model in the vram without having to transfer anything is even more king, though
apitman 2 days ago Currently software is king when it comes to inference performance though. Almondsetat 2 days ago Having the entire model in the vram without having to transfer anything is even more king, though
Almondsetat 2 days ago Having the entire model in the vram without having to transfer anything is even more king, though
Currently software is king when it comes to inference performance though.
Having the entire model in the vram without having to transfer anything is even more king, though