Comment by curioussquirrel
7 hours ago
Yes, but it would hurt its contextual understanding and effectively reduce the context window several times.
7 hours ago
Yes, but it would hurt its contextual understanding and effectively reduce the context window several times.
Only in the current most popular architectures. Mamba and RWKV style LLMs may suffer a bit but don't get a reduced context in the same sense.