Comment by Retric
17 hours ago
> Why can’t the scientist and the news outlets be trusted to make the decision about whether to publish or not themselves? Why can’t the general public be trusted to evaluate the quality of the news outlets they read?
Because the scientists involved and reporters manifestly do a bad job about picking what is or isn’t groundbreaking and more importantly have various incentives to hype things up.
CERN scientists with the whole FTL neutrino particle were actively skeptical of the results and still held a press conference on the topic. As to reporters, you’re welcome to go through the published stories about the topic and notice how rarely getting the distance wrong was brought up even when the scientists involved where skeptical. https://en.wikipedia.org/wiki/2011_OPERA_faster-than-light_n...
The general public is utterly incompetent at judging science. Homeopathy is the tip of the iceberg of ignorance.
You didn’t answer the actually interesting question I posed, who should be the gatekeeper instead?
Yes, yes, journalists and scientists have bad incentives and the general public is dumb. You’re not exactly setting the world on fire with that observation. The problem is that there is no better alternative. Any conceivable gatekeeper to scientific knowledge will be no smarter than the research scientists producing the results and will certainly have problematic incentives of their own. And a gatekeeper will also lack the local knowledge that might determine whether the information might helpful or harmful to the potential reader.
Programming reinvented a similar system of peer review before commits. It’s not that the reviewer is more knowledgeable about the bits of the system being changed that makes this work it’s that they have enough expertise to understand what’s involved and a new set of eyes on the problem.
In science having multiple journals acts as a safety valve here, but the underlying principle is very similar. As much as some people bad mouth it, peer review is a very low hurdle before publication that still catches a great number of mistakes.