← Back to context Comment by altano 4 hours ago How much memory does this use of the test machine's (M3 Max) 128 GB unified memory? 2 comments altano Reply WASDx 3 hours ago The model is only 0.3B params so probably not much. putna 3 hours ago Physical footprint: 560.4M Physical footprint (peak): 778.0M
The model is only 0.3B params so probably not much.
Physical footprint: 560.4M Physical footprint (peak): 778.0M