Comment by kbyatnal

15 hours ago

Yeah that can occasionally work and something we've tested, but it introduces a lot of noise unfortunately and makes systematic evals difficult.

0 comments