Comment by janalsncm
1 year ago
> I always had the LLM play as white against Stockfish—a standard chess AI—on the lowest difficulty setting
I think the author was comparing against Stockfish at a lower skill level (roughly, the number of nodes explored in a move).
Did the same and gpt-3.5-turbo-instruct still lost all the games. maybe a diff in stockfish version ? I am using stockfish 16
Huh. Honestly, your answer makes more sense, LLMs shouldn’t be good at chess, and this anomaly looks more like a bug. Maybe the author should share his code so it can be replicated.