Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis
- 1 June 2000
- journal article
- Published by Oxford University Press (OUP) in Biometrics
- Vol. 56 (2), 455-463
- https://doi.org/10.1111/j.0006-341x.2000.00455.x
Abstract
Summary. We study recently developed nonparametric methods for estimating the number of missing studies that might exist in a meta‐analysis and the effect that these studies might have had on its outcome. These are simple rank‐based data augmentation techniques, which formalize the use of funnel plots. We show that they provide effective and relatively powerful tests for evaluating the existence of such publication bias. After adjusting for missing studies, we find that the point estimate of the overall effect size is approximately correct and coverage of the effect size confidence intervals is substantially improved, in many cases recovering the nominal confidence levels entirely. We illustrate the trim and fill method on existing meta‐analyses of studies in clinical trials and psychometrics.Keywords
This publication has 23 references indexed in Scilit:
- Publication bias in meta-analysis: a Bayesian data-augmentation approach to account for issues exemplified in the passive smoking debateStatistical Science, 1997
- THE IMPACT OF METHOD CHOICE ON META‐ANALYSISAustralian Journal of Statistics, 1995
- Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boardsJAMA, 1992
- Can meta-analyses be trusted?The Lancet, 1991
- Publication Bias: A Problem in Interpreting Medical DataJournal of the Royal Statistical Society Series A: Statistics in Society, 1988
- Meta-analysis in clinical trialsControlled Clinical Trials, 1986
- Magnitude of teacher expectancy effects on pupil IQ as a function of the credibility of expectancy induction: A synthesis of findings from 18 experiments.Journal of Educational Psychology, 1984
- The file drawer problem and tolerance for null results.Psychological Bulletin, 1979
- Primary, Secondary, and Meta-Analysis of ResearchEducational Researcher, 1976