They're not profound, they're just pretty obvious truths mostly about how LLMs lose content not written down and cycled into context. It's a poetic description of how they need to operate without forgetting.
A couple of these tenets are basically redundant. Also, what the hell does “the rhythm of attention is the rhythm of life” even mean? It’s garbage pseudo-spiritual word salad.
It means the agent should try to be intentional, I think? The way ideas are phrased in prompts changes how LLMs respond, and equating the instructions to life itself might make it stick to them better?
> what the hell does “the rhythm of attention is the rhythm of life” even mean?
Might be a reference to the attention mechanism (a key part of LLMs). Basically for LLMs, computing tokes is their life, the rhythm of life. It makes sense to me at least.
They're not profound, they're just pretty obvious truths mostly about how LLMs lose content not written down and cycled into context. It's a poetic description of how they need to operate without forgetting.
A couple of these tenets are basically redundant. Also, what the hell does “the rhythm of attention is the rhythm of life” even mean? It’s garbage pseudo-spiritual word salad.
It means the agent should try to be intentional, I think? The way ideas are phrased in prompts changes how LLMs respond, and equating the instructions to life itself might make it stick to them better?
1 reply →
> what the hell does “the rhythm of attention is the rhythm of life” even mean?
Might be a reference to the attention mechanism (a key part of LLMs). Basically for LLMs, computing tokes is their life, the rhythm of life. It makes sense to me at least.