Comment by cold_harbor
1 day ago
the reason 50GB swap is even viable here is Apple Silicon's memory bandwidth. on x86 that much swap would make inference unusably slow
1 day ago
the reason 50GB swap is even viable here is Apple Silicon's memory bandwidth. on x86 that much swap would make inference unusably slow
Memory bandwidth or storage bandwidth?
potato potatoh