Replication in action: the workshop

In March this year, we organised a replication expert workshop with all PI’s and/or executive researchers from the replication studies in our project. The aim of the workshop was to specify the concerns and ideas about what a good replication study is about, and to think about policy advice and guidelines for future replication practices. In this blog post we report about some of the experiences and ideas that were brought up in this workshop.

Heterogeneity

In statistics, variation between the outcome measures of one study or between the results of similar studies is called ‘heterogeneity’. Multi-lab replications of a single original study present some interesting challenges: heterogeneity can be difficult to interpret.

How funding shapes research in practice

Time and budget restrictions as well as other funding criteria can shape how science is being done in practice. Here, we describe the impact of NWO funding specifications on “our” replication research projects. Funder stage: What kinds of replications should receive funding? In 2017, the Dutch science funding organisation NWO earmarked three million euros for … Continue reading How funding shapes research in practice

Kinds of replication

In their article 'Self-correction in science: The diagnostic and integrative motives for replication', David Peterson and Aaron Panofsky (2021) distinguish two kinds of replication: diagnostic and integrative replication. In this blog post we discuss how well these categories apply to the studies in our sample, and we propose to distinguish a third kind of replication … Continue reading Kinds of replication

What characterizes replication studies? First impressions.

In this blog post we report first observations and impressions from our study following 24 recently funded replication studies in practice. NWO funding calls for replication studies: what were the characteristics? The aim of the three replication calls, according to the NWO website, was to encourage researchers to carry out replication research and thus to … Continue reading What characterizes replication studies? First impressions.

The Replication in Action project

In the last decade, concerns have been raised in several fields of research about the reproducibility of research findings. Our project, funded by the Dutch Research Council (NWO) aims to increase our understanding of the practical and epistemological issues at stake in replication studies. If a result is not reproducible in a replication study, does that mean that the original claim was false? And if not, how may we explain the failure to reproduce? Reproducibility of results by different researchers is generally considered an important touchstone of the validity of scientific claims, but there are a number of complexities associated with replication and reproducibility. We are going to study how these issues are dealt with in practice. In this post we describe how we will do this.