Comment by chairhairair
3 hours ago
This company is just irresponsible. We (at least, Americans that vote and can therefore decide indirectly what’s legal) should not allow them to continue.
3 hours ago
This company is just irresponsible. We (at least, Americans that vote and can therefore decide indirectly what’s legal) should not allow them to continue.
This type of sentiment is almost always motivated by fear over the potential negative personal economic impact from AI (e.g. losing employment).
Publishing a math paper and then unpublishing it is not "irresponsible". It's just a math paper.
Irresponsible is an adjective that means lacking a proper sense of responsibility, or acting without thinking about or caring about the potential consequences of one's actions.
They do not care if they waste everyone’s time or flood the common with slop. They did not spend their own time to verify that the Lean proofs correspond to the natural language proofs. They did not even spend their own time to verify that all of these proofs are well written.
They instead are mining the unrenewable resource of open math problems.
However, seeing it another way is easy if you are financially motivated by their upcoming IPO (see how easy it is to invent motivations for comments?).
Actually they sat a highly illustrious group of mathematicians down to advise them before releasing -- illustrious enough that I am certain that they have more global standing than you do to make a good call. That group advised open release, which is what they are doing. It lets mathematicians interested and skilled in each area look at what we have. It is by no means irresponsible.
1 reply →
It is irresponsible when nobody checked it for correctness first. They just copy pasted what the slop machine spit out.
How is withdrawing a paper irresponsible?
it's like if you vibe coded something and the onus is now on the reviewer and the reviewer tells you your work contains bugs and is messy - that is not acceptable from the reviewers pov - why should the reviewer spend all his human effort, a scarce resource, reviewing your code while you've spent barely a fraction of his effort generating this. OpenAI is a trillion dollar company, surely they can verify stuff before pushing it out? The problem is not that they are solving the problems, they don't care at all about the actual process of doing mathematics. Using compute to mine problems and throwing results in github and letting human reviewers spend effort to correct these is not going to win them any favor. If OpenAI really cared about math, they would have someone on their side who actually understood the results they produced and was able to verify their correctness and educate others.
They only withdrew it after someone pointed out that it was a flawed paper.
In one case by asking Astra to review it.
Not exactly encouraging that they did their homework before publishing results.
This is how science is meant to work.
7 replies →
Withdrawing it, in itself, might not be, but it kind of skips over the part where they have a paper that warrants it in the first place.
Withdrawing it isn't irresponsible. I don't even think releasing it is, because that is often the best way to find problems with it; expose it to the wider research community. Doing PR victory laps based on unverified, unfinished work, on the other hand, is. It is well known, even scientifically demonstrated, that retractions or refutations get much less attention than the initial exuberant PR announcement. And thus this practice contributes to misinformation.
And just to preempt the kneejerk whataboutism: Yes, all of academia does this to varying extents, and the mainstream media are also complicit. And that is also irresponsible. And no, that is not an excuse for OpenAI. Especially when you consider that OpenAI actively portray themselves as some kind of moral arbiter on AI and "doing good for humanity". They should be held to the extraordinarily high moral standards they purport to hold themselves to.