Comment by novaleaf
5 hours ago
can you recommend any benchmark websites that show up-to-date details like this?
TerminaBench, DeepSwe sites are out of date.
5 hours ago
can you recommend any benchmark websites that show up-to-date details like this?
TerminaBench, DeepSwe sites are out of date.
Yeah it’s a shame a lot of these benchmarks are behind. My favourite was ‘SlopCodeBench’ [1] as I’m most interested in ai reinforcing its own bad decisions, but it’s not even up to current gen oai
1: https://www.scbench.ai/