Comment by dwa3592
5 days ago
If you want a local alternative; I added image support to OpenDecision three days ago - https://github.com/deepanwadhwa/OpenDecision
Videos will be next.
5 days ago
If you want a local alternative; I added image support to OpenDecision three days ago - https://github.com/deepanwadhwa/OpenDecision
Videos will be next.
I see it runs locally, yes? What are hardware requirements?
It uses this model, MoritzLaurer/ModernBERT-large-zeroshot-v2.0, which can be run on pretty quaint hardware. You likely do not need a GPU, probably 2gb ram minimum on top of whatever you are already hosting
Just added this at the top of the repo. For text only, 1.1GB ram, for images 1.4GB. context windows for text (2 model choices) - 512-8192 tokens.