Comment by trilogic
6 hours ago
Minimax has been a strong player in our tests, if they managed to solve the inference speed issue(be scared, be very scared). A decent speed is at least 13 tps in consumer hardware. Let see if it passes Hugston bench this time, we really hope so.
It did okay in Pac-Man. Not great, but a usable example. Unfortunately, it did take half an hour. I'm trying to figure out what the pricing would be if it wasn't free. But zero dollars is a great entry price.
https://jonclegg.github.io/pacman-bakeoff/#minimax-m3.1-flas...
13 TPS is painfully slow?
20 t/s is about the speed you can read at, so slower than that and it always feels like it's buffering. 35 t/s is where it starts feeling decent and 50 t/s feels nice.
I know, it is never enough, more, more, give me more. But the fact is that no one has broken though yet to offer a frontier like open weight over 13 tps in consumer hardware. It would be usable at 13tps for me, especially considering the benefits and advantages of privacy, infinite tokens, availability and no refusals/restrictions. To this day Minimax and GLM are very strong coders but have the same issue, inference speed. We need a real break through, one that thinks out of the box (Tesla turbines style perhaps).
I just use the strongest model I can run at a non-frustrating speed. That's never frontier performance on local hardware, but most of us running locally accepted that a long time ago.
Currently on R9700 + 64GB of RAM I'm running Qwen3.8-Flash-Next. It's decent.
If all you're going to do is chat with an AI, you don't need a 400B parameter MoE model.
13 TPS is unusable for agentic coding, because if decode is that slow, then prefill is absolutely abysmal, and agentic work live and die by prefill speeds.
I’ve been agentic coding at home with like 15 TPS on average. I don’t mind it at all. I can give my agent a big task or a list of little ones and just… do something else. Why do I need to watch it work?
1 reply →
> If all you're going to do is chat with an AI, you don't need a 400B parameter MoE model.
Why wouldn't I want the smartest possible model I can get? I only "chat" about smart person stuff.
Why does agentic work live and die by prefill speeds?
4 replies →
It feels even slower when you consider thinking traces and tool calls which are skimmable at best.