Comment by docheinestages
6 days ago
Look into FastContext by Microsoft. Not extraordinary but specifically designed for paired usage with a larger LLM to save tokens [1].
6 days ago
Look into FastContext by Microsoft. Not extraordinary but specifically designed for paired usage with a larger LLM to save tokens [1].
This may be useful in this context: https://entelligentsia.github.io/is-grep-enough/fastcontext....
That repo suddenly seems to have gone missing. I get 404.
Oh, I just realized Microsoft removed it a couple weeks ago. I had the link in my bookmarks. The model is available on HuggingFace [1].
[1]: https://huggingface.co/models?sort=trending&search=fastconte...