← Back to context

Comment by dwa3592

5 days ago

If you want a local alternative; I added image support to OpenDecision three days ago - https://github.com/deepanwadhwa/OpenDecision

Videos will be next.

3 comments

dwa3592

Reply
kkarpkkarp  4 days ago

I see it runs locally, yes? What are hardware requirements?

  • 12345hn6789  4 days ago

    It uses this model, MoritzLaurer/ModernBERT-large-zeroshot-v2.0, which can be run on pretty quaint hardware. You likely do not need a GPU, probably 2gb ram minimum on top of whatever you are already hosting

  • dwa3592  4 days ago

    Just added this at the top of the repo. For text only, 1.1GB ram, for images 1.4GB. context windows for text (2 model choices) - 512-8192 tokens.