Comment by dorianmariecom 2 days ago written with claude lol 2 comments dorianmariecom Reply ncruces 2 days ago Did they ask Claude "don't cheat" this time round? ModernMech 2 days ago You joke but when benchmarking with ai this is important. When you tell it optimize X, it will do so at any cost, including cheezing benchmarks. So you have to make sure you tell it what it can’t optimize along with what it can.
ncruces 2 days ago Did they ask Claude "don't cheat" this time round? ModernMech 2 days ago You joke but when benchmarking with ai this is important. When you tell it optimize X, it will do so at any cost, including cheezing benchmarks. So you have to make sure you tell it what it can’t optimize along with what it can.
ModernMech 2 days ago You joke but when benchmarking with ai this is important. When you tell it optimize X, it will do so at any cost, including cheezing benchmarks. So you have to make sure you tell it what it can’t optimize along with what it can.
Did they ask Claude "don't cheat" this time round?
You joke but when benchmarking with ai this is important. When you tell it optimize X, it will do so at any cost, including cheezing benchmarks. So you have to make sure you tell it what it can’t optimize along with what it can.