Comment by dnautics
4 days ago
Reading files is not that input tokien heavy, I suspect. But anyways I omitted it because presumably it would have done so to gain local context in general.
4 days ago
Reading files is not that input tokien heavy, I suspect. But anyways I omitted it because presumably it would have done so to gain local context in general.
I still don't follow. Why doesn't that count as cost?
A+B > A+C => B > C
The LLM doesn't need to read the whole file in example 2). Why would it?
3 replies →