Comment by lupire
4 years ago
Floating point isn't relevant here.
The problem is that human language is approximate and correct math is not, so pattern matching on prose text is doomed. AI trained on exact math does a lot better. But that's not fully generic so fails the weird GPT goal of modeling all of human intelligence through prose. That's not how people solve math at all.
GPT's "Superficially plausible but wrong" math is actually pretty good match for non-expert bad-at-math average human behavior.
> GPT's "Superficially plausible but wrong" math is actually pretty good match for non-expert bad-at-math average human behavior.
Relevant blog post: https://www.greaterwrong.com/posts/YhgjmCxcQXixStWMC/artific... "The best experts in the field estimate it will be at least a hundred years before calculators can add as well as a human twelve-year-old."
I like Yudkovsky parodying himself there although I still don't know if he has a sense of humor or not.