Comment by cmiles8
6 days ago
Science isn’t suffering from a lack of papers. It’s suffering from a lack of good papers. Making it easier to just pump out paper-mill publications is about the last thing science needs right now.
6 days ago
Science isn’t suffering from a lack of papers. It’s suffering from a lack of good papers. Making it easier to just pump out paper-mill publications is about the last thing science needs right now.
My hope is that the flood of AI articles pushes the academic publication system to its highly-anticipated breaking point.
The most absurd part is that everyone in academia knows that publish or perish is tremendously damaging to real research. Yet we’re all hostage of this system that we created in the name of “merit” and “efficiency”.
We need a different system to identify and reward talented hard-working people. Back in the day it all relied on actual interpersonal interaction and subjective judgment, but there were also much fewer researchers worldwide.
> My hope is that the flood of AI articles pushes the academic publication system to its highly-anticipated breaking point.
This will just make research inaccessible to most researchers. There is no incentive to limit publishing, at all, other than at the highest echelons. Publish or perish will just become worse. Look at what is happening to programming and extrapolate that to research work.
And all for what? Just to keep up this facade of society until most of society can be excised, whether artificially or naturally though lack of reproduction.
It will get much worse before it gets better.
Oh it's getting there. I've turned down several referee requests this year because the paper looks like AI slop. A lot of it seems to come from China.
Scientific research is suffering from a reproducibility crisis. Not a publication crisis. LLM's aren't going to solve reproducibility issues.
They are going to make it a thousands times worse.
It wasn't perfect before, but it at least took some time to fake a paper. The problem is now people can produce a very plausible looking completely fake paper in minutes. Peer review is in the process of completely collapsing, in fact I think it's already basically done.
The only way this might fix things is if we require all papers are completely reproducable (that doesn't help in subjects like biology of course. They can still provide all the experimental data in the rawest format possible which doesn't break any laws).
In some fields like comp sci, when code isn't given but the paper describes the approach, LLMs do help with the reproducibility crisis: you can ask it to reproduce the result through reimplementation by reading the paper.
If it fails you may have to double check it did properly reimplement it, but if it succeeds you do get a reproduction.
The two feed into each other. "Publish or perish" ups the incentive to pump out shaky papers to pad resumes. LLMs make it easier to churn them out.
I'm actually quite excited for when (if) the models get good enough to start replicating compsci papers. I'd love it if there was a system which calculated a reproducibility score per-lab or per-researcher, which I could look up alongside their citation count.
I want to see who did the hard work properly, and who focused on publishing with concealed details.
it's suffering from having 1 million researchers, when there aren't 1 million important easy problems to solve, yet you must publish something
It seems to me that LLM's could massively improve reproducibility issues if journals would require that the papers be reproducible by model X using a standardized prompt in < N minutes, etc...
Sorry, how would that work for literally any non-computational science? You just can't submit papers that involve actual reality?
Por que no los dos? Scientific review times are up, it’s harder to find reviewers, and many reviews are AI generated anyway. Auto-generated research publications will arguably make the replication crisis worse, because there will be more slop to clog up the review system, and these papers will presumably be just as (if not more) not reproducible than human written science
it could also be said that scientific interpretation is suffering from a framework crisis. the scientific convention of experiment, is the test of an hypothesis, as a logical construct.
repetition of materials and methods toward reproducibility, holds far less wieght than multiple variants of process designed to test a common hypothesis resulting in agreement.[null, or failure to null]
Underlying reproducibility is integrity.
Underlying integrity is rigor.
Underlying rigor is education.
It goes deep, for sure, IMO.
They're gonna worsen it
Isn't this just blanket cynicism?
In the long run conceivable we could use AI to hold papers to a much higher standard, audit all the data and code that is associated etc.
6 replies →