← Back to context

Comment by andai

4 hours ago

I think this is an unsolved problem. The most interesting thing I saw here is the Recursive Language Models paper.

https://arxiv.org/abs/2512.24601

There's also a great write up here by the author:

https://alexzhang13.github.io/blog/2025/rlm/

I used this architecture for a while. The problem I have with it is that starting from one agent and fanning out keeps things mostly aligned with that single reasoning trajectory, even as you get a few layers into the stack. Every recursive invocation is a product of the caller's current state. Diversity doesn't really occur on its own unless the environment (tool calling) is complex/chaotic.

RLM might be more useful on the execution side than on the research side. In fact, these somehow feel like they might be exact inverses of each other in terms of what the ideal architecture looks like. At some point you definitely do need something in the middle that has it all sorted out.