← Back to context Comment by kkarpkkarp 5 days ago I see it runs locally, yes? What are hardware requirements? 2 comments kkarpkkarp Reply 12345hn6789 4 days ago It uses this model, MoritzLaurer/ModernBERT-large-zeroshot-v2.0, which can be run on pretty quaint hardware. You likely do not need a GPU, probably 2gb ram minimum on top of whatever you are already hosting dwa3592 4 days ago Just added this at the top of the repo. For text only, 1.1GB ram, for images 1.4GB. context windows for text (2 model choices) - 512-8192 tokens.
12345hn6789 4 days ago It uses this model, MoritzLaurer/ModernBERT-large-zeroshot-v2.0, which can be run on pretty quaint hardware. You likely do not need a GPU, probably 2gb ram minimum on top of whatever you are already hosting
dwa3592 4 days ago Just added this at the top of the repo. For text only, 1.1GB ram, for images 1.4GB. context windows for text (2 model choices) - 512-8192 tokens.
It uses this model, MoritzLaurer/ModernBERT-large-zeroshot-v2.0, which can be run on pretty quaint hardware. You likely do not need a GPU, probably 2gb ram minimum on top of whatever you are already hosting
Just added this at the top of the repo. For text only, 1.1GB ram, for images 1.4GB. context windows for text (2 model choices) - 512-8192 tokens.