Investigating Variation in Replicability
Top Cited Papers
Open Access
- 1 May 2014
- journal article
- Published by Hogrefe Publishing Group in Social Psychology
- Vol. 45 (3), 142-152
- https://doi.org/10.1027/1864-9335/a000178
Abstract
Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344 participants. In the aggregate, 10 effects replicated consistently. One effect – imagined contact reducing prejudice – showed weak support for replicability. And two effects – flag priming influencing conservatism and currency priming influencing system justification – did not replicate. We compared whether the conditions such as lab versus online or US versus international sample predicted effect magnitudes. By and large they did not. The results of this small sample of effects suggest that replicability is more dependent on the effect itself than on the sample and setting used to investigate the effect.Keywords
This publication has 29 references indexed in Scilit:
- Imagining Intergroup Contact Can Improve Intergroup AttitudesGroup Processes & Intergroup Relations, 2007
- Why Most Published Research Findings Are FalsePLoS Medicine, 2005
- Should We Trust Web-Based Studies? A Comparative Analysis of Six Preconceptions About Internet Questionnaires.American Psychologist, 2004
- Complementary Justice: Effects of "Poor but Happy" and "Poor but Honest" Stereotype Exemplars on System Justification and Implicit Activation of the Justice Motive.Journal of Personality and Social Psychology, 2003
- Math = male, me = female, therefore math ≠ me.Journal of Personality and Social Psychology, 2002
- The Return of the Repressed: Dissonance Theory Makes a ComebackPsychological Inquiry, 1992
- Under what conditions does theory obstruct research progress?Psychological Review, 1986
- The TEA Set: Tacit Knowledge and Scientific NetworksScience Studies, 1974
- Postdecision dissonance at post time.Journal of Personality and Social Psychology, 1968
- Experiments in Wording Questions: IIPublic Opinion Quarterly, 1941