← Back to context

Comment by unrented7977

7 hours ago

At work we've got a 96BG Blackwell card serving Qwen3.8:27b at well over 100tok/s. Most of the time it's way faster than codex. Just this morning I set qwen and codex on the same task and Qwen came back flagging problems Sol 6.1 missed.

Local models are going to absolutely eat OAI's lunch before too long. The only moat left is hardware cost, and they can't keep it artificially high for too much longer.