Comment by therealpygon

4 days ago

I took a break from commercial plans and was using local qwen/glimmer/gemma and hosted glm/DS4.1-flash for things; opus 5.5 is night and day difference to return to. It makes some mistakes certainly, but its commits are often exactly the change I would have made with far less babysitting. It also shows that fable spark of common sense of “hey…you realize this other thing is broken too right?” without getting lost in the weeds immediately like other models seem do. Still an idiot sometimes though... “Oh no, I’ve discovered the exact same thing we have discussed and you have approved 5 times, and I’ve made notes about…I don’t know what to do, can you tell me to read my own note I’ve just reviewed and ignored?”

Exactly. And without setting a /goal for the harness to loop it, it also did essentially this today after a few hours of work:

  I finished optimization A. Optimizations B and C that we planned look super promising. Shall we continue? 

  <Stop here> <Implement B>

  50 minutes ago 

It's also happy to write multiple paragraphs about different implementation options, where the ticket's acceptance criteria already rules out all but one.

The outputs are still often verbose and the language always is convoluted Claude-speak.

Even for typical day-to-day software engineering work, there is still much room for improvement.