It seems to have trouble remembering the whole context, even when its limit is only half full. Three times this weekend I've had to switch to Fable, where I literally ask "review the recent conversation and tell me where we went offtrack" and Fable immediately identifies the problems that Opus was having.
I'm doing data science stuff so it isn't super complicated code; it is about applying valid statistical procedures and techniques. Still, on the code part, Opus 5 had a lot of trouble merging 2 branches yesterday...
On a tangent, I am beginning to understand why we have replication crisis in academia. I thought C++ was full of footguns; it has nothing on statistics. With statistics, you don't get a compiler error or a crash when you hold it wrong.
I remember when 4.7 and 4.8 were released and people were asking what's wrong with them and 4.6 is the best.
But yes, I also think it's not the greatest model for programming. On the other hand, for agentic tasks that are not programming related it's hard to beat Opus 4.8. It can try different things and pivot even when the user is not great with prompting. 5.0 seems to not be worse, but definitely wastes more tokens and costs more.
It seems to have trouble remembering the whole context, even when its limit is only half full. Three times this weekend I've had to switch to Fable, where I literally ask "review the recent conversation and tell me where we went offtrack" and Fable immediately identifies the problems that Opus was having.
I'm doing data science stuff so it isn't super complicated code; it is about applying valid statistical procedures and techniques. Still, on the code part, Opus 5 had a lot of trouble merging 2 branches yesterday...
On a tangent, I am beginning to understand why we have replication crisis in academia. I thought C++ was full of footguns; it has nothing on statistics. With statistics, you don't get a compiler error or a crash when you hold it wrong.
I remember when 4.7 and 4.8 were released and people were asking what's wrong with them and 4.6 is the best.
But yes, I also think it's not the greatest model for programming. On the other hand, for agentic tasks that are not programming related it's hard to beat Opus 4.8. It can try different things and pivot even when the user is not great with prompting. 5.0 seems to not be worse, but definitely wastes more tokens and costs more.
4.6 was better in some way that I can’t put my finger on. None of the models since have been able to reproduce its quality of output for me.
is, not was. Thankfully 4.6 is still being served by Anthropic.