Comment by Art9681
4 hours ago
It's going to be faster no matter what. My M3 MAX prints tokens faster than I can read for the new MoE models. It's the prompt processing that kills it when the context grows beyond a threshold which is easy to do in the modern agentic loops.
No comments yet
Contribute on Hacker News ↗