Comment by pcf

Wow, Kimi K2.5 runs on a single M3 Ultra with 512 GB RAM?

Can you share more info about quants or whatever is relevant? That's super interesting, since it's such a capable model.