Comment by simonw
3 hours ago
If they try something and it doesn't work and they then try something else and it DOES work that's concrete feedback.
3 hours ago
If they try something and it doesn't work and they then try something else and it DOES work that's concrete feedback.
Are you saying the machine can tell you what confused them?
Yes. Try a prompt like this:
> In our recent conversations were there any instances where you attempted a tool call, got an error, then adjusted your tool call and were successful? Suggest improvements to the tool instructions that would have avoided the initial error.
A year ago I don't think this would have worked. The frontier models have been trained to be able to write prompts for themselves, mainly so they can effectively use sub-agents.