Comment by liuliu
3 hours ago
DeepSeek 4.1 Flash 0910 is perfect for M5 Ultra 256GiB. Running it fully resident in RAM, prefill at ~2500 tok/s and decode at ~40 tok/s. Probably tons of room to improve from there.
3 hours ago
DeepSeek 4.1 Flash 0910 is perfect for M5 Ultra 256GiB. Running it fully resident in RAM, prefill at ~2500 tok/s and decode at ~40 tok/s. Probably tons of room to improve from there.
Which quantization are you using there?
My own: https://huggingface.co/drawthingsai/DeepSeek-V4.1-Flash/tree...
You are running this now? :o