Comment by Xcelerate
4 hours ago
I’m a bit surprised OpenAI isn’t finding these big results far faster than the product’s user base. With no limits on runtime, access to dev models, custom tuning, and top talent, you’d think there’d be a constantly running internal project with the goal of solving famous math problems. And who knows, perhaps there is, but it would be interesting to compare the rate of success per unit “effort” of the internal mathematics work with that of the user base.
"OpenAI's internal team solves famous maths problem" is technically impressive but dispiriting. Non-experts solving a problem by just throwing resources at it is kind of the worst possible optics for knowledge workers. It's just disempowering.
"Famous mathematician uses ChatGPT to solve famous math problem" is equally technically impressive, but now you're telling those very same knowledge workers "that famous mathematician could've been you". It puts you in the driver's seat, and provides a clear path forward — subscribe, use our product, and reap the rewards.
You're surprised they didn't eat the tokens to churn on lots of open problems instead of asking others to pay for those tokens? They're in the token business. If they're eating the tokens, it's in support of a marketing effort, not in support of innovation across the frontier of all the other academic disciplines. The collective frontier is way too big for them to just "solve it" without asking society to at least help them break even on such an enormous public good.
How could they?
That's why the free market works, millions of agents in parallel beats any planned economy (by humans)
They do have some of those.
https://openai.com/index/model-disproves-discrete-geometry-c...
Confirmation bias. There's likely a wide portion of chats in which "keep going" derails to madness. We then stop saying "keep going" because we notice there is something wrong, and we start another chat. In the end, we largely remember much better the interactions in which "keep going" resulted in something good, and forget about our role in stopping the train when it derails, which is something much harder to do unattended by a human.