Comment by eden-u4
10 days ago
How is it different from SlopCode Bench? Isn't this a change in spec after the first prompt as in SlopCode Bench?
10 days ago
How is it different from SlopCode Bench? Isn't this a change in spec after the first prompt as in SlopCode Bench?
No, this modified the original prompt, it didn't do a multi-round evaluation like slop code. It was a little hard to get that from the writeup, I had the same initial reaction.