An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science
Top Cited Papers
- 7 November 2012
- journal article
- Published by SAGE Publications in Perspectives on Psychological Science
- Vol. 7 (6), 657-660
- https://doi.org/10.1177/1745691612462588
Abstract
Reproducibility is a defining feature of science. However, because of strong incentives for innovation and weak incentives for confirmation, direct replication is rarely practiced or published. The Reproducibility Project is an open, large-scale, collaborative effort to systematically examine the rate and predictors of reproducibility in psychological science. So far, 72 volunteer researchers from 41 institutions have organized to openly and transparently replicate studies published in three prominent psychological journals in 2008. Multiple methods will be used to evaluate the findings, calculate an empirical rate of replication, and investigate factors that predict reproducibility. Whatever the result, a better understanding of reproducibility will ultimately improve confidence in scientific methodology and findings.Keywords
This publication has 14 references indexed in Scilit:
- Measuring the Prevalence of Questionable Research Practices With Incentives for Truth TellingPsychological Science, 2012
- Raise standards for preclinical cancer researchNature, 2012
- Bite-Size Science and Its Undesired Side EffectsPerspectives on Psychological Science, 2012
- Tracking Replicability as a Method of Post-Publication Open EvaluationFrontiers in Computational Neuroscience, 2012
- Fearing the Future of Empirical Psychology: Bem's (2011) Evidence of Psi as a Case Study of Deficiencies in Modal Research PracticeReview of General Psychology, 2011
- False-Positive PsychologyPsychological Science, 2011
- Believe it or not: how much can we rely on published data on potential drug targets?Nature Reviews Drug Discovery, 2011
- Evaluating the consistency and specificity of neuroimaging data using meta-analysisNeuroImage, 2009
- Increasing Replication for Knowledge Accumulation in Strategy ResearchJournal of Management, 2003
- Consequences of prejudice against the null hypothesis.Psychological Bulletin, 1975