Comment by elphinstone
21 hours ago
I read the whole article, but have never tried the model. Looking at the input document, I believe the model saw enough of a space between the 14 and 5 to simply treat it that way. I saw the space too. Impressive, but it's a leap to say it saw 145 then used higher order reasoning to correct 145 to 14 and 5.
I also read the whole article, and this behaviour that the author is most excited about only happened once. For a process that inherently has some randomness about it, I feel it's too early to bit this excited.
Yep. A lot of things looked magical in the GPT-4 days. Eventually you realised it did it by chance and more often than not gets it wrong