Comment by lukan 1 year ago Cheating (using a internal chess engine) would be the obvious reason to me. 6 comments lukan Reply nske 1 year ago But in that case there shouldn't be any invalid moves, ever. Another tester found gpt-3.5-turbo-instruct to be suggesting at least one illegal move in 16% of the games (source: https://blog.mathieuacher.com/GPTsChessEloRatingLegalMoves/ ) TZubiri 1 year ago Nope. Calls by api don't use functions calls. girvo 1 year ago How can you prove this when talking about someones internal closed API? permo-w 1 year ago that you know of TZubiri 1 year ago Sure. It's not hard to verify, in the user ui, function calls are very transparent.And in the api, all of the common features like maths and search are just not there. You can implement them yourself.You can compare with self hosted models like llama and the performance is quite similar.You can also jailbreak and get shell into the container to get some further proof 1 reply →
nske 1 year ago But in that case there shouldn't be any invalid moves, ever. Another tester found gpt-3.5-turbo-instruct to be suggesting at least one illegal move in 16% of the games (source: https://blog.mathieuacher.com/GPTsChessEloRatingLegalMoves/ )
TZubiri 1 year ago Nope. Calls by api don't use functions calls. girvo 1 year ago How can you prove this when talking about someones internal closed API? permo-w 1 year ago that you know of TZubiri 1 year ago Sure. It's not hard to verify, in the user ui, function calls are very transparent.And in the api, all of the common features like maths and search are just not there. You can implement them yourself.You can compare with self hosted models like llama and the performance is quite similar.You can also jailbreak and get shell into the container to get some further proof 1 reply →
permo-w 1 year ago that you know of TZubiri 1 year ago Sure. It's not hard to verify, in the user ui, function calls are very transparent.And in the api, all of the common features like maths and search are just not there. You can implement them yourself.You can compare with self hosted models like llama and the performance is quite similar.You can also jailbreak and get shell into the container to get some further proof 1 reply →
TZubiri 1 year ago Sure. It's not hard to verify, in the user ui, function calls are very transparent.And in the api, all of the common features like maths and search are just not there. You can implement them yourself.You can compare with self hosted models like llama and the performance is quite similar.You can also jailbreak and get shell into the container to get some further proof 1 reply →
But in that case there shouldn't be any invalid moves, ever. Another tester found gpt-3.5-turbo-instruct to be suggesting at least one illegal move in 16% of the games (source: https://blog.mathieuacher.com/GPTsChessEloRatingLegalMoves/ )
Nope. Calls by api don't use functions calls.
How can you prove this when talking about someones internal closed API?
that you know of
Sure. It's not hard to verify, in the user ui, function calls are very transparent.
And in the api, all of the common features like maths and search are just not there. You can implement them yourself.
You can compare with self hosted models like llama and the performance is quite similar.
You can also jailbreak and get shell into the container to get some further proof
1 reply →