Comment by 0x457

Usually it boils down these questions (this is given you have some sorts of AGENTS.md file):

- is this code that been written many times already?

- Is there a way to verify the solution? (think unit test, it has to be something agent can do on its own)

- Does the starting context has enough information for it to start going in the right direction? (I had claud and openhands instantly digging themselves holes, and then I realized there was zero context about the project)

- Is there anything remotely similar already done in the project?

> Are we at a stage where an LLM (assuming it doesn't find the solution on its own, which is ok) would come back to me and say, listen, I've tried your approach but I've run into this particular difficulty, can you advise me what to do, or would it just write incorrect code that I would then have to carefully read and realise what the challenge is myself?

I've had LLM telling me it couldn't do and offered me some alternative solutions. Some of them are useful and working; some of them are useful, but you have a better one; Some feel like they made by a non-technical guy at a purely engineering meetings.