Comment by xeyownt

It's not obvious from the prompt that the LLM cannot use a chess engine.

And if there is alignment issue, the alignment requirements should first be stated BEFORE running the experiment, and should be part of the training process. It's not. So there is not necessarily an alignment issue.