← Back to context

Comment by llamaimperative

2 years ago

There are multiple reproducibility crises. The incentive structure is one of them, the other being the general challenge of reproducing results further "up the stack" in highly chaotic fields (the stack being physics -> chem -> bio -> psychology -> sociology, obviously nonexhaustive)

I actually find the reproducibility crisis you're mentioning to be both more problematic and to receive far less attention than the other. More problematic because it infects every form of science, even the harder/more fundamental sciences, and because it's way less clear how to fix it.

The reproducibility crisis near the top of the stack is just: "do more science and don't believe results until they've been replicated, refined, and matured."

3 comments

llamaimperative

Reply
7thaccount  2 years ago

Ah gotcha. Good point.

I've always felt that the psychology/sociology studies of the week I hear about on the radio were likely based on some weak statistics in the best of cases and most likely difficult to reproduce.