← Back to context

Comment by boardwaalk

3 hours ago

I let it go a few hours on a not trivial but well-known problem, and it felt like it was just a little too plodding and just kind of mucked around a little too much and wasn't aggressive enough about getting stuff done. I asked it to wind it down and finish up and it took another hour and 15 to actually stop and commit without really getting much more done. Not very impressed here, if you can't tell. This new version also seems like (maybe this is written somewhere, I don't care to look.) this cycles through compactions every ~250k tokens which, I guess, seems like it might save Anthropic money on KV cache but does net me anything be pretty frequent pauses. (It didn't seem to lose the thread, at least.)

Not gonna say I want 5.0 as an option still... but maybe I do.

I experience this with many of the "advanced" models. I find they're actually the most efficient on their low/medium settings, occasionally high. Anything higher than that, and they start inventing more task list items than they check off. They seem to think that every personal project needs extensive adversarial analysis and guardrails and will invent non-issues without being asked.