Comment by knollimar
4 days ago
>I'm either going to ask the AI how to do it
LLMs seem terrible at using LLMs in harnesses. Have you seen how they rot their context with the stuff they put in .md files if you let them?
You'd have to have the LLMs search, and thus these resources could be for them more than you
Yes, but I have had moderate luck with creating an "agent-instructor" skill that has strict instructions around keeping language strong, unambiguous, concise, and always presenting me with exact diffs to review before writing anything.
Another thing in it is a strict line count. Any increase in line count requires my approval. That last one is important because it plays well with two biases: models don't tend to create long lines so they won't try to cheat that way, and they're strongly inclined to keep churning out lines so I take that away from them.
Did you tell Claude "make an agent instructor skill, whatever you think is good, go for it," or did you use the knowledge you had gained about how AI works and how to write good instructions for it?
No, I typed this one by hand as if it was 2019. But I don't write all agent instructions by hand because I don't think that I have any particularly high skill at doing that. I review carefully to ensure that my exact requirements are being expressed, hence why I said it must present me with exact diffs to review. But when it comes up the exact structure and wording I suspect me and the agent are equally bad at it.
1 reply →