Skip to content
Center of
Trial & Error
← All issues

Special Issue: Consequences of the Scientific Reform Movement

  • 24 May 2024
  • 8 articles

8 articles

All articles
Editorial

Reflections on the Unintended Consequences of the Science Reform Movement

Sarahanne Field, Noah van Dongen & Leo Tiokhin

The scientific community has entered a challenging era, as originally noted by Wagenmakers (2012) . High-profile instances of fraud, failures to replicate foundational studies in psychology, and admissions of research misconduct (John et al., 2012) cast a shadow over the field of psychology…

doi:10.36850/ed4Read
Meta-Research

Reputation Without Practice? A Dynamic Computational Model of the Unintended Consequences of Open Scientist Reputations

Maximilian Linde, Merle-Marie Pittelkow, Nina R. Schwarzbach & Don van Ravenzwaaij

Practicing open science can have benefits for the career prospects of individual researchers or labs through higher quality work and increased chances of publication. However, being an outspoken advocate of open science might also indirectly benefit individual scientific careers, in the form of…

doi:10.36850/mr10Read
Meta-Research

Tension Between Theory and Practice of Replication

Erkan O. Buzbas & Berna Devezer

A core problem that has been addressed in the scientific reform movement so far is the low rates of reproducibility of research results. Mainstream reform literature has aimed at increasing reproducibility rates by implementing procedural changes in research practice and scientific policy. At the…

doi:10.36850/mr9Read
Meta-Research

A Manifesto for Rewarding and Recognizing Team Infrastructure Roles

Arielle Bennett, Daniel Garside, Cassandra Gould van Praag, Thomas J. Hostler, Ismael Kherroubi Garcia, Esther Plomp, Antonio Schettino, Samantha Teplitzky & Hao Ye

The Scientific Reform Movement has highlighted the need for large research teams with diverse skills. This has necessitated the growth of professional team infrastructure roles (TIRs) who support research through specialised skills, but do not have primary responsibility for conceiving or leading…

doi:10.36850/mr8Read
Meta-Research

Rethinking Transparency and Rigor from a Qualitative Open Science Perspective

Crystal N. Steltenpohl, Hilary Lustick, Melanie S. Meyer, Lindsay Ellis Lee, Sondra M. Stegenga, Laurel Standiford Reyes & Rachel L. Renbarger

Discussions around transparency in open science focus primarily on sharing data, materials, and coding schemes, especially as these practices relate to reproducibility. This fairly quantitative perspective of transparency does not align with all scientific methodologies. Indeed, qualitative…

doi:10.36850/mr7Read
Meta-Research

Reflections on Preregistration: Core Criteria, Badges, Complementary Workflows

Robert T. Thibault, Charlotte R. Pennington & Marcus R. Munafò

Clinical trials are routinely preregistered. In psychology and the social sciences, however, only a small percentage of studies are preregistered, and those preregistrations often contain ambiguities. As advocates strive for broader uptake and effective use of preregistration, they can benefit from…

doi:10.36850/mr6Read
Meta-Research

The Invisible Workload of Open Research

Thomas J. Hostler

It is acknowledged that conducting open research requires additional time and effort compared to conducting ‘closed’ research. However, this additional work is often discussed only in abstract terms, a discourse which ignores the practicalities of how researchers are expected to find the time to…

doi:10.36850/mr5Read
Meta-Research

Questionable Metascience Practices

Mark Rubin

Metascientists have studied questionable research practices in science. The present article considers the parallel concept of questionable metascience practices (QMPs). A QMP is a research practice, assumption, or perspective that has been questioned by several commentators as being potentially…

doi:10.36850/mr4Read