Comment by threethirtytwo

Does this even make sense? Clearly anthropic won't release a model unless it passed a benchmark of some sort that proves it's better than the previous model... or else why would they even release it?

It's obvious if this thing shows degradation, than there is another thing that is showing improvement.