Comment by jerf

Just for the sake of argument and using some admittedly insane numbers, give me Opus 4.5 at a tenth the cost and running ten times as fast and I'd take that for almost any coding task over any current frontier model. There was a real phase transition somewhere in that range and improvements since then, while impressive and useful and by the benchmarks quite large, have in practice not been anywhere near as big a phase change. Honestly until we get to the point where the models don't need any checking at all, incremental improvements on how much checking they need don't do all that much for me. In practice "they get 90%" doesn't differ much from "they get 94%".