Comment by vFunct
2 months ago
The challenge for LLMs over the next year is to get them to operate on large data sets/code bases with millions/billions of tokens through some kind of distributed hierarchical framework, with each LLM operating on a local set of 20k or whatever subset of tokens.
any reading?
I’m just a user, trying out the models first hand on a large project, learning as I go.