Comment by computerex
1 year ago
Maybe there's some difference in the setup because the OP reports that the model beats stockfish (how they had it configured) every single game.
1 year ago
Maybe there's some difference in the setup because the OP reports that the model beats stockfish (how they had it configured) every single game.
You have to get the model to think in PGN data. It's crucial to use the exact PGN format it sae in its training data and to give it few shot examples.
OP had stockfish at its weakest preset.
Did the same and gpt-3.5-turbo-instruct still lost all the games. maybe a diff in stockfish version ? I am using stockfish 16
That is a very pertinent question, especially if Stockfish has been used to generate training data.