Comment by jaredklewis

A paper being peer reviewed is a good sign, but I feel like the signal is usually over interpreted.

Peer reviewed does not mean the findings of the paper are established fact or scientific consensus. It does not mean that the findings have been replicated by other scientists. It does not mean that the paper relied on a robust methodology, is free of basic statistical errors, or even free of logical fallacies.

Some of these limitations are due to the limitations of peer review itself. Others are just side effects of the way science works (for example, some ideas start as small, unimpressive experiments that are reported on in papers, and the strength of the findings is gradually developed over time). Obviously sometimes the prestige (or lack thereof) of the journal the paper is in decreases (or increases) some of these issues.

Anyway, peer review is a very noisy channel (IMHO).