Comment by Topfi
10 days ago
Terminalbench numbers are publicly available. What is more interesting, why is that the only benchmark they highlight. Maybe 5.6 isn’t that far ahead of Fable 5 in DeepSWE and FrontierCode (which I consider the most useful and close to my evals + subjective experience)…
Yes, they only report the most saturated benchmark, which they were already very strong in before. It is very clear this model is nowhere near Fable, unfortunately.