Frequency and impact of confounding by indication and healthy vaccinee bias in observational studies assessing influenza vaccine effectiveness: a systematic review
Open Access
- 17 October 2015
- journal article
- research article
- Published by Springer Science and Business Media LLC in BMC Infectious Diseases
- Vol. 15 (1), 1-15
- https://doi.org/10.1186/s12879-015-1154-y
Abstract
Evidence on influenza vaccine effectiveness (VE) is commonly derived from observational studies. However, these studies are prone to confounding by indication and healthy vaccinee bias. We aimed to systematically investigate these two forms of confounding/bias. Systematic review of observational studies reporting influenza VE and indicators for bias and confounding. We assessed risk of confounding by indication and healthy vaccinee bias for each study and calculated ratios of odds ratios (crude/adjusted) to quantify the effect of confounder adjustment. VE-estimates during and outside influenza seasons were compared to assess residual confounding by healthy vaccinee effects. We identified 23 studies reporting on 11 outcomes. Of these, 19 (83 %) showed high risk of bias: Fourteen due to confounding by indication, two for healthy vaccinee bias, and three studies showed both forms of confounding/bias. Adjustment for confounders increased VE on average by 12 % (95 % CI: 7–17 %; all-cause mortality), 9 % (95 % CI: 4–14 %; all-cause hospitalization) and 7 % (95 % CI: 4–10 %; influenza-like illness). Despite adjustment, nine studies showed residual confounding as indicated by significant off-season VE-estimates. These were observed for five outcomes, but more frequently for all-cause mortality as compared to other outcomes (p = 0.03) and in studies which indicated healthy vaccinee bias at baseline (p = 0.01). Both confounding by indication and healthy vaccinee bias are likely to operate simultaneously in observational studies on influenza VE. Although adjustment can correct for confounding by indication to some extent, the resulting estimates are still prone to healthy vaccinee bias, at least as long as unspecific outcomes like all-cause mortality are used. Therefore, cohort studies using administrative data bases with unspecific outcomes should no longer be used to measure the effects of influenza vaccination.Keywords
This publication has 42 references indexed in Scilit:
- The test-negative design for estimating influenza vaccine effectivenessVaccine, 2013
- Influenza Vaccine Effectiveness in the Elderly Based on Administrative Databases: Change in Immunization Habit as a Marker for BiasPLOS ONE, 2011
- Why do covariates defined by International Classification of Diseases codes fail to remove confounding in pharmacoepidemiologic studies among seniors?Pharmacoepidemiology and Drug Safety, 2011
- Maternal Influenza Immunization and Reduced Likelihood of Prematurity and Small for Gestational Age Births: A Retrospective Cohort StudyPLoS Medicine, 2011
- Influenza vaccination and all-cause mortality in community-dwelling elderly in Ontario, Canada, a cohort studyVaccine, 2010
- Challenges in evaluating influenza vaccine effectiveness and the mortality benefits controversyVaccine, 2009
- New strategies are needed to improve the accuracy of influenza vaccine effectiveness estimates among seniorsJournal of Clinical Epidemiology, 2009
- Burden of Influenza‐Like Illness and Effectiveness of Influenza Vaccination among Working Adults Aged 50–64 YearsClinical Infectious Diseases, 2009
- Influenza vaccination and risk of community-acquired pneumonia in immunocompetent elderly people: a population-based, nested case-control studyThe Lancet, 2008
- Effect of influenza vaccine status on winter mortality in Spanish community-dwelling elderly people during 2002–2005 influenza periodsVaccine, 2007