Comment by tsimionescu

I don't understand what you mean that "there are not that many of them". The models, even the best ones, still have clear problems with certain kinds of real world reasoning, and it's not a known, closed set. With some prodding and knowing this error mode, I think it's not hard to trip any model with a novel reasoning error like this.

And no, I don't think humans would make the same errors, the key reason for this failure mode is that there are some facts of human day to day life that are so mundane that they are virtually never written about, thus making them an ideal combination of universal human experiences but out of distribution for the LLMs.