← Back to context

Comment by afpx

4 days ago

How about a big vetted database like arxiv of all hypotheses, all proposed experiments to test them, and all experimental results?

Vetted by who?

To be clear I'd be very much in favor of scientific studies and their data having to be publicly available.

But on any controversial area, which is most of the areas anyone cares about, there will be 2+ sides of the issue and any vetting body will be compromised to some degree for one of those sides.

  • That's the rub, isn't it... who watches the watchmen? In times past, journalism at least had the veil of impartiality, but modern journalism is far more of an editorial activist activity than simply answering the 6 W's of a given story.

    I'm not sure it was ever actually much better... and it may just be my pessimistic Gen X nature. But I've personally seen too many misrepresentations about too many studies where the body and available data in fact don't match the headlines or the numbers themselves are deceptive in a way that is much less significant than represented.

    200% the risk of X... when in sample A of 10000, 1 had X, and in sample b of the same size, 2 had X... while it's a real relative stat, the absolute values are all but meaningless in context.

    • Yellow journalism existed generations before you and I. The institution was always sullied by the worst and has always contained some of the most dogged pestering fact finders.

      It’s not even clear that journalists of the 1960s-1980s were as impartial or brutally honest as we remember. That is most likely a halo effect from having a few highly trusted very visible personalities (eg. Walter Cronkite), but even they were slow to realize (by a decade) how much of a morass the Vietnam War was.

      1 reply →

Ya, I want it even bigger. All commercial claims should be accessible for your own determination. Fastest, biggest, longest, widest, shortest, most liked, doctor recommended, any empirical claim must have the data used and calculations to make the claim available for examination. Data storage is so cheap now. I don't see it as a dent to anyone's profit.

This would just be impractical. Nothing would ever get done. Too many potential experiments.

arxiv is an open-access journal that checks for spam. It is very much not "vetted" lol