Comment by otabdeveloper4
2 hours ago
> show me a 4th grade math problem they can't handle
Sure.
"8 7 6 5 4 3 2 1 - add minus signs and parenthesis to get 31."
P.S. There is an answer online and some LLMs will just copy it verbatim. This doesn't count.
Whoa, 4th grade math problems got hard! I'm not sure how I'd tackle that one myself.
GPT-5.5 found a solution only after assuming that you're allowed to concatenate numbers together e.g. 8 7 becomes 87 (it complained at first that it was "under-specified") - using Python it brute-forced a solution (actually finding 13): https://chatgpt.com/share/6a1db54f-7ab8-8333-9218-86a469c284...
Are you sure this is 4th grade level?
[dead]