Comment by Dylan16807

> If you gradually increase RAM, more and more of the weights are cached and the speed improves quite a bit

It'll increase a lot based on the zero-ram baseline. But it's still complete garbage compared to fitting the model in RAM. Even if you fit most of it in RAM you're still probably an order of magnitude slower than fitting all of it in RAM, most of your time spent waiting for your SSD.