Comment by nonbel
6 years ago
This is the best description of the main problem (testing your own vs some default hypothesis) I have seen:
Paul E. Meehl, "Theory-Testing in Psychology and Physics: A Methodological Paradox," Philosophy of Science 34, no. 2 (Jun., 1967): 103-115. https://doi.org/10.1086/288135
Free download here: www.fisme.science.uu.nl/staff/christianb/downloads/meehl1967.pdf
Andrew Gelman (andrewgelman.com) has a great blog that often touches on this issue.
Thanks a bunch for sharing, I appreciate it. I'll add these resources to my reading list. I may also pass it along to my brother who getting a graduate degree in psych :)