Improving Psychological Science through Transparency and Openness: An Overview
- 14 November 2018
- journal article
- research article
- Published by Springer Science and Business Media LLC in Perspectives on Behavior Science
- Vol. 42 (1), 13-31
- https://doi.org/10.1007/s40614-018-00186-8
Abstract
The ability to independently verify and replicate observations made by other researchers is a hallmark of science. In this article, we provide an overview of recent discussions concerning replicability and best practices in mainstream psychology with an emphasis on the practical benefists to both researchers and the field as a whole. We first review challenges individual researchers face in producing research that is both publishable and reliable. We then suggest methods for producing more accurate research claims, such as transparently disclosing how results were obtained and analyzed, preregistering analysis plans, and publicly posting original data and materials. We also discuss ongoing changes at the institutional level to incentivize stronger research. These include officially recognizing open science practices at the journal level, disconnecting the publication decision from the results of a study, training students to conduct replications, and publishing replications. We conclude that these open science practices afford exciting low-cost opportunities to improve the quality of psychological science.Keywords
This publication has 81 references indexed in Scilit:
- Improving the Dependability of Research in Personality and Social PsychologyPersonality and Social Psychology Review, 2013
- Advancing Science Through Collaborative Data Sharing and SynthesisPerspectives on Psychological Science, 2013
- Measuring the Prevalence of Questionable Research Practices With Incentives for Truth TellingPsychological Science, 2012
- Too good to be true: Publication bias in two prominent studies from experimental psychologyPsychonomic Bulletin & Review, 2012
- Statistical power analyses using G*Power 3.1: Tests for correlation and regression analysesBehavior Research Methods, 2009
- Quantifying heterogeneity in a meta-analysisStatistics in Medicine, 2002
- When choice is demotivating: Can one desire too much of a good thing?Journal of Personality and Social Psychology, 2000
- Within-subjects designs: To use or not to use?Psychological Bulletin, 1976
- Consequences of prejudice against the null hypothesis.Psychological Bulletin, 1975
- Competence and Conformity: Another Look at Hollander's StudySociometry, 1972