Novel methods to deal with publication biases: secondary analysis of antidepressant trials in the FDA trial registry database and related journal publications
Open Access
- 7 August 2009
- Vol. 339 (aug07 1), b2981
- https://doi.org/10.1136/bmj.b2981
Abstract
Objective To assess the performance of novel contour enhanced funnel plots and a regression based adjustment method to detect and adjust for publication biases.Design Secondary analysis of a published systematic literature review.Data sources Placebo controlled trials of antidepressants previously submitted to the US Food and Drug Administration (FDA) and matching journal publications. Methods Publication biases were identified using novel contour enhanced funnel plots, a regression based adjustment method, Egger’s test, and the trim and fill method. Results were compared with a meta-analysis of the gold standard data submitted to the FDA.Results Severe asymmetry was observed in the contour enhanced funnel plot that appeared to be heavily influenced by the statistical significance of results, suggesting publication biases as the cause of the asymmetry. Applying the regression based adjustment method to the journal data produced a similar pooled effect to that observed by a meta-analysis of the FDA data. Contrasting journal and FDA results suggested that, in addition to other deviations from study protocol, switching from an intention to treat analysis to a per protocol one would contribute to the observed discrepancies between the journal and FDA results.Conclusion Novel contour enhanced funnel plots and a regression based adjustment method worked convincingly and might have an important part to play in combating publication biases.This publication has 59 references indexed in Scilit:
- Contour-enhanced meta-analysis funnel plots help distinguish publication bias from other causes of asymmetryJournal of Clinical Epidemiology, 2008
- Selective Publication of Antidepressant Trials and Its Influence on Apparent EfficacyThe New England Journal of Medicine, 2008
- Performance of the trim and fill method in the presence of publication bias and between‐study heterogeneityStatistics in Medicine, 2007
- Arcsine test for publication bias in meta‐analyses with binary outcomesStatistics in Medicine, 2007
- Association Between Unreported Outcomes and Effect Size Estimates in Cochrane Meta-analysesJAMA, 2007
- Comparison of Two Methods to Detect Publication Bias in Meta-analysisJAMA, 2006
- A modified test for small‐study effects in meta‐analyses of controlled trials with binary endpointsStatistics in Medicine, 2005
- Empirical Evidence for Selective Reporting of Outcomes in Randomized TrialsJAMA, 2004
- Adjusting for publication bias in the presence of heterogeneityStatistics in Medicine, 2003
- How should meta‐regression analyses be undertaken and interpreted?Statistics in Medicine, 2002