Slacker News Slacker News logo featuring a lazy sloth with a folded newspaper hat
  • top
  • new
  • show
  • ask
  • jobs
Library
← Back to context

Comment by moosedev

19 hours ago

You're correct, the base (non-Pro, non-Max) chips are still not great for local LLMs. M5 and M6 both improved prefill speed/time-to-first-token over prior gens, but bw is still a bottleneck.

There's rumored to be no M6 Pro or M6 Max coming, i.e. the higher bandwidth chips will skip a gen. M7 is also rumored to have better memory bandwidth across the range.

0 comments

moosedev

Reply

No comments yet

Contribute on Hacker News ↗

Slacker News

Product

  • API Reference
  • Hacker News RSS
  • Source on GitHub

Community

  • Support Ukraine
  • Equal Justice Initiative
  • GiveWell Charities