Comment by nico
5 days ago
In case you need something a bit more lightweight, or want privacy. You can get amazing (better in a lot of cases) accuracy and performance from local models that run and train on CPU: https://jeffyclassify.com/blog/when-llms-fail-at-classificat...
I used the model and it was good enough for email classification. I was wondering if I'm supposed to be doing multiple runs for topic classification with grouping related topics i.e. if its sport,economy or tech related news and then another run for soccer,basketball or something else or batching them like the News article topic classification example in a single run.
[flagged]
Anything like this that can just run entirely in browser without needing an external application?
Yes, you can adapt it to run on the browser: http://jeffyclassify.com/blog/mind-reader/
It's also open source, https://github.com/nicobrenner/jeffy it's in the roadmap to build something for the browser. Do you want to take a stab at it and submit a PR?
I just got it to work using python in wasm from pyodide.
2 replies →