Comment by lyjackal
10 hours ago
I've been curious to see the process for selecting relevant context from a long conversation. has anyone reverse engineered what that looks like? how is the conversion history pruned, and how is the latest state of a file represented?
We didn't look into that workflow closely, but you can reproduce our work (code in GitHub) and potentially find some insights!
We plan to continue investigating how it works (+ optimize the models and prompts using TensorZero).