A comparison of statistical methods for combining event rates from clinical trials
- 1 February 1989
- journal article
- research article
- Published by Wiley in Statistics in Medicine
- Vol. 8 (2), 141-151
- https://doi.org/10.1002/sim.4780080202
Abstract
We compare two statistical methods for combining event rates from several studies. Both methods treat each study as a separate stratum. The Peto-modified Mantel—Haenszel (Peto) method estimates a combined odds ratio assuming homogeneity across strata and provides a test for heterogeneity. The DerSimonian and Laird modified Cochran method (D&L) produces a weighted average of rate differences, where the weights allow for among-study variability. We analyse 22 meta-analyses from ten reports by both methods. The pooled estimates are divided by their standard errors to produce a Z-statistic. A t-test comparing Z-statistics from all 22 studies suggests that the D&L method tends to be more conservative [d(Peto—D&L) = 0.29, t = 2.53, p = 0.02]. For a subset of 14 non-heterogeneous studies, the difference is smaller and non-significant (d = 0.09, t = 0.72, p = 0.49). The results from the methods correlate well (r = 0.66 for all 22 studies, r = 0.95 for 14 non-heterogeneous studies). Thus, the presence of heterogeneity influences our conclusion. We discuss the statistical and scientific implications of these findings.Keywords
This publication has 10 references indexed in Scilit:
- Publication Bias: A Problem in Interpreting Medical DataJournal of the Royal Statistical Society Series A: Statistics in Society, 1988
- Inter‐study differences: How should they influence the interpretation and analysis of results?Statistics in Medicine, 1987
- Meta-Analyses of Randomized Controlled TrialsThe New England Journal of Medicine, 1987
- The concept of an overview of cancer clinical trials with special emphasis on early breast cancer.Journal of Clinical Oncology, 1986
- Meta-analysis in clinical trialsControlled Clinical Trials, 1986
- Findings for Public Health From Meta-AnalysesAnnual Review of Public Health, 1985
- Beta blockade during and after myocardial infarction: An overview of the randomized trialsProgress in Cardiovascular Diseases, 1985
- Quantitative Methods for Literature ReviewsAnnual Review of Psychology, 1984
- CHOOSING THE PARAMETER FOR A 2 × 2 TABLE OR A 2 × 2 × 2 TABLE ANALYSISAmerican Journal of Epidemiology, 1979
- The Combination of Estimates from Different ExperimentsBiometrics, 1954