Comment by sarcasticsiri

Their own example of Claude being able to "reason" is rather funny-

https://docs.google.com/spreadsheets/d/1jIxjzUWG-6xBVIa2ay6y...

First it says that if you ask a logic problem without any system prompt it will not get it. But if you add a system prompt that "You are a logic bot designed to answer complex logic problems.", it will get it right.

It gets "a married person (Jack) is looking at an unmarried person (George)" which is simply incorrect!

They also add "Although notably not for all the right reasons", is it to justify the logic?