Comment by twobitshifter
9 hours ago
Probably the data center where the model is running more than anything. Another option is if Opus is using anything like a Mixture of Experts approach, in which case the amount of the model loaded in memory at one time could be smaller than GLM.
No comments yet
Contribute on Hacker News ↗