← Back to context

Comment by dofm

6 days ago

It’s still a dense model so all 27B parameters are active. 35B-A3B activates only 3B at any time.

0 comments

dofm

Reply

No comments yet

Contribute on Hacker News ↗