Comment by _aavaa_
1 day ago
Pre-registration is a pretty big one: essential you outline your research plan (what you’re looking for, how you will analyze the data, what bars you are setting for significance, etc.) before you do any research. You plan is reviewed and accepted (or denied), often by both funding agency and journal you want to submit to, before they know the results.
Then you perform the experiment exactly* how you said you would based on the pre-registration, and you get to publish your results whether they are positive or negative.
* Changes are allowed, but must be explicitly called out and a valid reason given.
A huge benefit of that is that it would force the publication of null results, although there would still be no incentive for others to cite null result publications, and citations are unfortunately the main metric that determines the "value" of a scientist. Is there a way to make null result publications valuable?
Also, forcing pre-registration on everyone would be problematic because some types of research are not well-suited to strict planning and committee approval -- how would you quickly make adjustments to an experiment? how would you do exploratory data analysis? serendipitous discoveries would be suppressed? etc.
Wow, I didn't think it's possible, but it sounds like a great way to make research boring :).
What is boring about this? You get the guarantee of publishing your work, even if you get a negative result.
I take it you don’t do research. Cause boring is nothing compared to wasting month of time and money only to get a negative result that nobody will publish.
I'm not in the academy, but I do R&D, I published several times, and that's not how I work at all.
I have a broad and open-ended focus, I work as usual on the things I find interesting, then sometimes I see a thing that looks interesting and decide to investigate, then sometimes my initial tests give good results, but more often then they don't, but they give me an idea to do something completely different, and some iterations later I have a result.
I imagine that depends on a field of research. IT is cheap, but I imagine a physicist who wants to do an experiment must secure a funding first, because otherwise it's impossible to do anything. And it requires one to commit to a single topic of research.
3 replies →
From the perspective of a dishonest researcher, what are the compliance barriers to secretly doing the research work, and only after that doing the pre-registration?
You would need the funding anyway before you could start the research
One could implement some pipelining to avoid that problem.
A lack of money.
And really if you want to be dishonest it’s easier to manipulate the raw data then it is to secretly perform the experiments ahead of time.