Comment by kyars

I agree with you that choosing a subset and iterating to get an optimized version as good as SQLite or better is a better way to test and achieve more useful results. But with respect to the context size, Cursor has made agentic projects with over one million lines of code, so I would push back on that: https://cursor.com/blog/scaling-agents