← Back to context Comment by edude03 3 days ago Like 4. Definitely single digit. The P40s are slow af 1 comment edude03 Reply coolspot 3 days ago P40 has memory bandwidth of 346GB/s which means it should be able to do around 14+ t/s running a 24 GB model+context.
coolspot 3 days ago P40 has memory bandwidth of 346GB/s which means it should be able to do around 14+ t/s running a 24 GB model+context.
P40 has memory bandwidth of 346GB/s which means it should be able to do around 14+ t/s running a 24 GB model+context.