Underestimation of Standard Errors in Multi-site Time Series Studies
- 1 January 2004
- journal article
- research article
- Published by Ovid Technologies (Wolters Kluwer Health) in Epidemiology
- Vol. 15 (1), 57-62
- https://doi.org/10.1097/01.ede.0000092721.00997.f7
Abstract
Multi-site time series studies of the association of air pollution with mortality and morbidity have figured prominently in the literature as comprehensive approaches for estimating short-term effects of air pollution on health. Hierarchical models are generally used to combine site-specific information and to estimate pooled air pollution effects while taking into account both within-site statistical uncertainty and across-site heterogeneity. Within a site, characteristics of time series data of air pollution and health (small pollution effects, missing data, and highly correlated predictors) make the modeling of all sources of uncertainty challenging. One potential consequence is underestimation of the statistical variance of the site-specific effects to be combined. In this paper, we investigate the impact of variance underestimation on the pooled relative rate estimate. We focused on two-stage normal-normal hierarchical models and on underestimation of the statistical variance at the first stage. By mathematical considerations and simulation studies, we found that variance underestimation did not affect the pooled estimate substantially. However, the pooled estimate was somewhat sensitive to variance underestimation when the number of sites was small and underestimation was severe. These simulation results are applicable to any two-stage normal-normal hierarchical model for combining information of site-specific results (including meta-analyses), and they can easily be extended to more general hierarchical formulations. We also examined the impact of variance underestimation on the national average relative rate estimate from the National Morbidity, Mortality and Air Pollution Study. We found that variance underestimation as large as 40% had little effect on the national average.Keywords
This publication has 15 references indexed in Scilit:
- Invited Commentary: Air Pollution and Health--What Can We Learn from a Hierarchical Approach?American Journal of Epidemiology, 2002
- Airborne particles are a risk factor for hospital admissions for heart and lung disease.Environmental Health Perspectives, 2000
- Assessing confounding, effect modification, and thresholds in the association between ambient particles and daily deaths.Environmental Health Perspectives, 2000
- Combining Evidence on Air Pollution and Daily Mortality from the 20 Largest US Cities: A Hierarchical Modelling StrategyJournal of the Royal Statistical Society Series A: Statistics in Society, 2000
- Daily variations in air pollution and respiratory health in a multicentre study: the PEACE project. Pollution Effects on Asthmatic Children in EuropeEuropean Respiratory Journal, 1998
- Air Pollution and Mortality in Philadelphia, 1974-1988American Journal of Epidemiology, 1997
- Short term effects of ambient sulphur dioxide and particulate matter on mortality in 12 European cities: results from time series data from the APHEA projectBMJ, 1997
- Air pollution effects on hospital admission rates: A random effects modeling approachThe Canadian Journal of Statistics / La Revue Canadienne de Statistique, 1994
- Linear Smoothers and Additive ModelsThe Annals of Statistics, 1989
- Meta-analysis in clinical trialsControlled Clinical Trials, 1986