Comment by twobitshifter
2 hours ago
At some point there will be models that are ‘good enough’ and run on chinese chips, mobile processors, and run of the mill chips from Apple. Whether this is a one bit ternary model, innovations to limit the size of the context, or something else it is coming. The balance has already shifted to making these systems less resource intensive which is a clear need based on the enormous data center cost.
No comments yet
Contribute on Hacker News ↗