Robust variance estimation in meta‐regression with dependent effect size estimates
Top Cited Papers
- 1 January 2010
- journal article
- research article
- Published by Wiley in Research Synthesis Methods
- Vol. 1 (1), 39-65
- https://doi.org/10.1002/jrsm.5
Abstract
Conventional meta-analytic techniques rely on the assumption that effect size estimates from different studies are independent and have sampling distributions with known conditional variances. The independence assumption is violated when studies produce several estimates based on the same individuals or there are clusters of studies that are not independent (such as those carried out by the same investigator or laboratory). This paper provides an estimator of the covariance matrix of meta-regression coefficients that are applicable when there are clusters of internally correlated estimates. It makes no assumptions about the specific form of the sampling distributions of the effect sizes, nor does it require knowledge of the covariance structure of the dependent estimates. Moreover, this paper demonstrates that the meta-regression coefficients are consistent and asymptotically normally distributed and that the robust variance estimator is valid even when the covariates are random. The theory is asymptotic in the number of studies, but simulations suggest that the theory may yield accurate results with as few as 20–40 studies. Copyright © 2010 John Wiley & Sons, Ltd.Keywords
This publication has 20 references indexed in Scilit:
- Multivariate Meta-Analysis: The Effect of Ignoring Within-Study CorrelationJournal of the Royal Statistical Society Series A: Statistics in Society, 2009
- Hierarchical Dependence in Meta-AnalysisJournal of Educational and Behavioral Statistics, 2009
- Impact of approximating or ignoring within‐study covariances in multivariate meta‐analysesStatistics in Medicine, 2007
- Systematic Phonics Instruction Helps Students Learn to Read: Evidence from the National Reading Panel’s Meta-AnalysisReview of Educational Research, 2001
- On tests of the overall treatment effect in meta‐analysis with normally distributed responsesStatistics in Medicine, 2001
- Restricted unbiased iterative generalized least-squares estimationBiometrika, 1989
- Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample propertiesJournal of Econometrics, 1985
- Fitting Continuous Models to Effect Size DataJournal of Educational Statistics, 1982
- Fitting Continuous Models to Effect Size DataJournal of Educational Statistics, 1982
- A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for HeteroskedasticityEconometrica, 1980