Comment by andai

2 months ago

My phone still has gpt-4o which gets it right: https://files.catbox.moe/0yg6cu.jpg

But my browser has gpt-5 which says 3: https://files.catbox.moe/63qkce.jpg

Claude spells it out letter by letter: https://files.catbox.moe/f1irfx.jpg

So I thought GPT-5 Thinking might get it right, and it does: https://files.catbox.moe/xlchnr.jpg

It refuses to show the thinking process for this question though, so its unclear if it even used the reasoning model or fell back on a non reasoning one.

> While GPT‑5 in ChatGPT is a system of reasoning, non-reasoning, and router models, GPT‑5 in the API platform is the reasoning model that powers maximum performance in ChatGPT. Notably, GPT‑5 with minimal reasoning is a different model than the non-reasoning model in ChatGPT, and is better tuned for developers. The non-reasoning model used in ChatGPT is available as gpt-5-chat-latest.

https://openai.com/index/introducing-gpt-5-for-developers/

2 comments

andai

Reply
acters  2 months ago

I asked GPT 5 to spell out the individual letters of strawberry or blueberry. It did it correctly by essentially putting a space char in between the letters.

Then I simply asked it to count all unique letters in the word. GPT 5 still got it completely correct without thinking.

Lastly I asked how many r(or b) is in the word. This one for some reason switched to GPT 5 thinking with few seconds of reasoning. It out put the correct number.

I guess starting the conversation by painstakingly walking it over to the correct answer helps it out. Idk it's a silly test