Comment by sdesol

The solution that I am working on is designed to leverage cheap LLMs (think MiMo, GLM, etc.) to build cheap context to reduce tokens, but most importantly to keep the context clean.

https://github.com/gitsense/chat/tree/update-readme

The README and latest version is still being worked on but I am hoping to have the latest release in place soon.