Comment by criley2
3 hours ago
For me, qwen 3.8 27b on my m5 max is so slow and dumb that I can't think of a single use for it. Haiku, Luna, or data center scale open models are ten times faster and ten times smarter (and inference so cheap that it's essentially free). It was a nifty toy to brag to friends about but why would I waste my time goofing with something so slow and dumb?
Try DeepSeek 4.1 Flash 1017, feels much better: https://github.com/drawthingsai/local-code-community
For roughly the same reason you might slow down and read a book on how to do something as opposed to speedrunning 20 youtube videos?
On my Mac Mini M4 Pro with 48G I find Qwen 3.8 27B perfectly usable, useful and fast enough.
Are you trying to one shot create the Linux kernel?