Comment by GuB-42
9 days ago
Are predictive keyboards like you have on most smartphones a good use case for these models?
It certainly would fit. My entry level phone has 6GB of RAM and more than enough computing power to run such a model as fast as I can type.
Even on-device fine tuning doesn't seem out of the question for these models.
No comments yet
Contribute on Hacker News ↗