Comment by altano 6 hours ago How much memory does this use of the test machine's (M3 Max) 128 GB unified memory? 3 comments altano Reply ImJasonH 23 minutes ago I had Fable one-shot the same demo from the same weights on an iPhone 15 Pro and it decides in ~40ms. WASDx 6 hours ago The model is only 0.3B params so probably not much. putna 5 hours ago Physical footprint: 560.4M Physical footprint (peak): 778.0M
ImJasonH 23 minutes ago I had Fable one-shot the same demo from the same weights on an iPhone 15 Pro and it decides in ~40ms.
I had Fable one-shot the same demo from the same weights on an iPhone 15 Pro and it decides in ~40ms.
The model is only 0.3B params so probably not much.
Physical footprint: 560.4M Physical footprint (peak): 778.0M