Comment by redman25
10 months ago
I think only 2/3 of ram is allocated to be available to the gpu, so like 14gb which is probably not enough to run even Q4 quant.
10 months ago
I think only 2/3 of ram is allocated to be available to the gpu, so like 14gb which is probably not enough to run even Q4 quant.
This is configurable by the way.
sudo sysctl iogpu.wired_limit_mb=12345