ORGANIZATION FOR HUMAN BRAIN MAPPING
At the 2016 Organization for Human Brain Mapping Annual Meeting, the establishment of an award to recognize the best replication study was announced. This award highlights OHBM’s commitment to reproducibility in neuroimaging research and helps begin to reshape the incentives towards replication. More information will be sent in the Fall with instructions for submission; however, we wanted to provide you with the details of the award to help you gather needed information to meet the criteria.
- The study must meet the below definition of a replication study be relevant to the field of human neuroimaging
- The study must be published in a peer-reviewed journal or deposited into a recognized preprint archive (such as biorXiv and arXiv) before the 22nd of February 2017.
- Submission deadline: February 22, 2017, recipient announced mid-April 2017.
- Please note: Current OHBM elected leadership are ineligible to receive OHBM Awards.
What is a Replication Study?
A replication study is a repetition of a published study procedure with minor changes to variables assumed not to be important for the measured phenomena (this depends on the experiment, but could include demographics, scanner model, visual stimuli delivery system, analysis strategy, etc.). Replication studies usually (but not always) have a larger sample size than the original study for appropriate statistical power, and are performed by a different team than the original study (but planning of a replication study can benefit from involvement of the original researchers). Even though minor changes between the original study and its replication are inevitable they should be minimized as much as possible.
What Makes a Good Replication Study?
A good replication study is a study that addresses an important topic for the neuroimaging community. The study needs to show highest standards of experimental design, data collection and statistical analysis. Openness of experimental procedures, pre-registration, data processing and statistical analyses as well as public availability of collected data also speak in favor of a good replication study. Authors should also show maturity and thoughtfulness when discussing results of the replication and should give the original authors an appropriate platform to comment on the replication. It is also worth noting that a good replication study does not necessarily have to show the same effect as the original study. Both “successful” and “unsuccessful” replication attempts will be considered for the award.
A link to a published paper or preprint along with a short paragraph explaining why this research should be awarded. Studies can be nominated by their authors or third parties.
Please submit all the required nomination information bu February 22, 2017 in a single pdf to OHBM Executive Office at firstname.lastname@example.org.
- A committee convened by OHBM would select the winner from the nominated papers. The award committee will include members of Program Committees from the past three years. Each member will have one vote. The number of votes received for each proposal will be publicly available.
- The initiators of the award (Chris Gorgolewski, Russell Poldrack, Jean Baptiste Poline, David Kennedy and Thomas Nichols) are not eligible to receive the award
The recipient will receive a cash award of $2,000 and an engraved plaque. Both are presented at the OHBM Annual Meeting. In 2017, this award will be funded by the Laura and John Arnold Foundation. After that time, the award will be funded by OHBM. The awardee will be given the opportunity to give a brief remark during the Annual Meeting.