Comment by jstanley

Asking an LLM to play chess by writing algebraic notation is like asking a human to play chess blindfolded.

Yes some people can do it but most people can't even if they're unusually intelligent.

You really need to be giving the LLM a board representation.

EDIT: I see that they actually were giving the LLMs a board representation and they still played badly. Fair enough then.