Comment by jph
5 hours ago
Lots of errors. Opus 5 is also giving me many more hallucinations, including things that aren't even in the right territory. It's also telling me that it's making many mistakes, and the language feels off-kilter as if it's not using typical clear phrases.
Yes, it’s way off field in many things, gets into weird minutia without seeing a way out, and it’s often seeing a clear sequence of work but then halts on a statement like “ok I’m going to start now.” Then after expiring the cache when I notice and ask why didn’t it the response is “no reason starting now!”
I see this behavior constantly in 5 - the quality of opus and fable have degraded constantly since 4.6 was such a riotous success
Quality of output of both Fable and Opus seems to have gone down quite a bit over the past week. Many mistakes.
Yeah I noticed informing me of mistakes it made during sessions. It felt really off when it informed me of a mistake it almost made but caught it before it landed.
It is aggressively proactive in ways that make it very hard to use. I had to turn down the effort level to “low” to stop it from going off in random directions every couple of turns.