Comment by another_twist
19 hours ago
The problem is with 0.05 criterion. In particle physics, the hypothesis tests are done two ways with the alternate hypothesis flipped to be the null hypothesis and it has a lower threshold of passing as in - we believe when theres very strong evidence else we dont. Atleast thats my read from the Higgs boson paper - https://higgsml.lal.in2p3.fr/files/2014/04/documentation_v1....
> The problem is with 0.05 criterion.
That's certainly one problem -- many have argued that it's too easy to meet this evidentiary standard, which explains why so many weak, non-replicable psychology papers get published.
You comment comparing psychology to physics is apt -- the evidentiary standard in hard science fields is much higher.