Comment by dt3ft
8 hours ago
Opus 4.8:
Which days in a week have the letter d in them?
Response:
Four: Monday, Tuesday, Wednesday, and Sunday.
8 hours ago
Opus 4.8:
Which days in a week have the letter d in them?
Response:
Four: Monday, Tuesday, Wednesday, and Sunday.
I can't reproduce this. Both high and low effort got it right
It seems like they’ve been optimising their models for coding. That’s what the benchmarks used in the article suggest at least.