Comment by dgellow 8 hours ago A bit of a meta question: what are the most relevant benchmarks by now? 3 comments dgellow Reply redox99 7 hours ago Terminal bench 4 is good largely because it's recent so it hasn't been benchmaxxed yet. It's more of a sysadmin/devops benchmark than a coding benchmark though, but still a decent proxy.https://artificialanalysis.ai/evaluations/terminalbench-v4-0 tetec1 7 hours ago Epoch.ai has a global score and tracks many benchmarks: https://epoch.ai/benchmarks andriy_koval 7 hours ago Nvidia and OpenAI claimed AGI, but you still have a job.
redox99 7 hours ago Terminal bench 4 is good largely because it's recent so it hasn't been benchmaxxed yet. It's more of a sysadmin/devops benchmark than a coding benchmark though, but still a decent proxy.https://artificialanalysis.ai/evaluations/terminalbench-v4-0
tetec1 7 hours ago Epoch.ai has a global score and tracks many benchmarks: https://epoch.ai/benchmarks
Terminal bench 4 is good largely because it's recent so it hasn't been benchmaxxed yet. It's more of a sysadmin/devops benchmark than a coding benchmark though, but still a decent proxy.
https://artificialanalysis.ai/evaluations/terminalbench-v4-0
Epoch.ai has a global score and tracks many benchmarks: https://epoch.ai/benchmarks
Nvidia and OpenAI claimed AGI, but you still have a job.