Comment by justinclift
14 hours ago
Looks like it. This quant ( https://huggingface.co/inferencerlabs/Kimi-K2.6-MLX-3.6bit ) says:
> Q3.6 typically achieves useable accuracy in our coding test and fits within a 512GB memory budget
This one ( https://huggingface.co/mlx-community/Kimi-K2.6-MoE-Smart-Qua... ) though says it fits on a 192GB mac:
> M3/M4 Ultra 192GB+ (fits in ~150GB)
No comments yet
Contribute on Hacker News ↗