Evidence‐based sample size calculations based upon updated meta‐analysis
- 13 April 2007
- journal article
- research article
- Published by Wiley in Statistics in Medicine
- Vol. 26 (12), 2479-2500
- https://doi.org/10.1002/sim.2704
Abstract
Meta‐analyses of randomized controlled trials (RCTs) provide the highest level of evidence regarding the effectiveness of interventions and as such underpin much of evidence‐based medicine. Despite this, meta‐analyses are usually produced as observational by‐products of the existing literature, with no formal consideration of future meta‐analyses when individual trials are being designed. Basing the sample size of a new trial on the results of an updated meta‐analysis which will include it, may sometimes make more sense than powering the trial in isolation. A framework for sample size calculation for a future RCT based on the results of a meta‐analysis of the existing evidence is presented. Both fixed and random effect approaches are explored through an example. Bayesian Markov Chain Monte Carlo simulation modelling is used for the random effects model since it has computational advantages over the classical approach. Several criteria on which to base inference and hence power are considered. The prior expectation of the power is averaged over the prior distribution for the unknown true treatment effect. An extension to the framework allowing for consideration of the design for a series of new trials is also presented. Results suggest that power can be highly dependent on the statistical model used to meta‐analyse the data and even very large studies may have little impact on a meta‐analysis when there is considerable between study heterogeneity. This raises issues regarding the appropriateness of the use of random effect models when designing and drawing inferences across a series of studies. Copyright © 2006 John Wiley & Sons, Ltd.Keywords
This publication has 33 references indexed in Scilit:
- IntroductionPublished by Wiley ,2003
- Methods for Meta-analysis in Medical Research. Alex J. Sutton, Keith R. Abrams, David R. Jones, Trevor A. Sheldon and Fujian Song, Wiley, Chichester, U.K., 2000. No. of pages: xvii+317. ISBN 0-471-49066-0Statistics in Medicine, 2003
- Measuring inconsistency in meta-analysesBMJ, 2003
- Sequential Methods for Meta‐AnalysisPublished by Wiley ,2002
- Quantifying heterogeneity in a meta-analysisStatistics in Medicine, 2002
- Advanced methods in meta‐analysis: multivariate approach and meta‐regressionStatistics in Medicine, 2002
- The power of statistical tests in meta-analysis.Psychological Methods, 2001
- The choice of sample sizeJournal of the Royal Statistical Society: Series D (The Statistician), 1997
- Is the study worth doing?The Lancet, 1993
- Meta-analysis in clinical trialsControlled Clinical Trials, 1986