Comment by kristianp
8 days ago
I've found the same thing with Claude Sonnet 4. I suggest something, it says great suggestion and agrees with me. I then ask it about the opposite approach and it says great job raising that and agrees with that too. I have no idea which is more correct in the end.
The LLM has literally no idea which one is better. It cannot think. It does not understand what it is putting on the screen.
This is why multi-pass sessions is something I try sometimes. "What's wrong with the solution your provided, how should it be done instead, and if you use any specific APIs or third party libraries research them to ensure complete accuracy of syntax, usage, and logic simplicity. Refactor your original solution to the correct minimum based on the ask."
Usually after running whatever it first spits out through this I get a bit better of a response or base I can build off of. Really, the best you can do is already know what you want and need and do very targeted sessions. Like the old saying goes, commit small and often.