Comment by druskacik

18 hours ago

Yeah, it's weird, considering ModernBERT, which the Laya models are based on, supports 8192 context window.

0 comments