Comment by tibbar

This is not an intelligence problem. It is in part an operational problem (have you properly set up the test), but it is mostly an alignment problem. Is the model cheating or not. Alignment is, indeed, very difficult.