Comment by otabdeveloper4
2 months ago
> LLM can wander through the codebase by itself and do research and build a "mental model"
It can't really do that due to context length limitations.
2 months ago
> LLM can wander through the codebase by itself and do research and build a "mental model"
It can't really do that due to context length limitations.
It doesn't need the entire codebase, it just needs the call map, the function signatures, etc. It doesn't have to include everything in a call - but having access to all of it means it can pick what seems relevant.
Yes, that's exactly right. The LLM gets a rough overview over the project (as you said, including function signatures and such) and will then decide what to open and use to complete/implement the objective.
In a real project the call map and function signatures are millions of tokens themselves.
For sufficiently large values of real.
4 replies →
1k LOC is perfectly fine, I did not experience issues with Claude with most (not all) projects around ~1k LOC.
Actual projects where you'd want some LLM help start with millions of lines of code, not thousands.
With 1k lines of code you don't need an LLM, the entire source code can fit in one intern's head.
The OP mentioned having LLM issues with 1k LOC, so I suppose he would have problems with millions. :D
Have you tried Claude Code yet?
Even with it's 200,000 token limit it's still really impressive at diving through large codebases using find and grep.
I guess people are talking about different kinds of projects here in terms of project size.