Comment by antupis
8 hours ago
Yup, new SOTA models especially with high/xhigh/max reasoning too often overengineer solutions, good for benchmarks that usually measure task completion, bad for normal development where you don't want 'rewrite in rust and 1k LOC unit tests' style solutions when agent does mundane bug fixes.
When it comes to mundane bug fixes the value is in actually finding the cause of the bug, and I find SOTA models way outperform smaller ones here. I don't care about their output - I can write the correct 5 line patch myself once I understand what's wrong.