Using computable knowledge mined from the literature to elucidate confounders for EHR-based pharmacovigilance
Preprint
- 10 July 2020
- preprint
- other
- Published by Cold Spring Harbor Laboratory
Abstract
Introduction: Confounding bias threatens the reliability of observational studies and poses a significant scientific challenge. This paper introduces a framework for identifying confounding factors by exploiting literature-derived computable knowledge. In previous work, we have shown that semantic constraint search over computable knowledge extracted from the literature can be useful for reducing confounding bias in statistical models of EHR-derived observational clinical data. We hypothesize that adjustment sets of literature-derived confounders could also improve causal inference.Methods: We introduce two methods (semantic vectors and string-based confounder search) that query the literature for potential confounders and use this information to build models from EHR-derived data to more accurately estimate causal effects. These methods search SemMedDB for indications TREATED BY the drug that is also known to CAUSE the adverse event. For evaluation, we attempt to rediscover associations in a publicly available reference dataset containing expected pairwise relationships between drugs and adverse events from empirical data derived from a corpus of 2.2M EHR-derived clinical notes. For our knowledge-base, we use SemMedDB, a database of computable knowledge mined from the biomedical literature. Using standard adjustment and causal inference procedures on dichotomous drug exposures, confounders, and adverse event outcomes, varying numbers of literature-derived confounders are combined with EHR data to predict and estimate causal effects in light of the literature-derived confounders. We then compare the performance of the new methods with naive (χ2, reporting odds ratio) measures of association.Results and Conclusions: Logistic regression with ten vector space-derived confounders achieved the most improvement with AUROC of 0.628 (95% CI: [0.556,0.720]), compared with baseline χ20.507 (95% CI: [0.431,0.583]). Bias reduction was improved more often in modeling methods using more rather than less information, and using semantic vector rather than string-based search. We found computable knowledge useful for improving automated causal inference, and identified opportunities for further improvement, including a role for adjudicating literature-derived confounders by subject matter experts.Graphical Highlights: Access to causal background knowledge is required for causal learning to scale to large datasets. We introduce a framework for identifying confounders to enhance causal inference from EHR. We search computable knowledge for indications TREATED BY the drug that CAUSE the outcome. Literature-derived confounders reduce confounding bias in EHR data. Structured knowledge helps interpret and explain data captured in clinical narratives.Keywords
This publication has 74 references indexed in Scilit:
- SemMedDB: a PubMed-scale repository of biomedical semantic predicationsBioinformatics, 2012
- Defining ‘Surveillance’ in Drug SafetyDrug Safety, 2012
- The lack of knowledge about the voluntary reporting system of adverse drug reactions as a major cause of underreporting: direct survey among health professionalsPharmacoepidemiology and Drug Safety, 2011
- A New Criterion for Confounder SelectionBiometrics, 2011
- Illustrating bias due to conditioning on a colliderInternational Journal of Epidemiology, 2009
- Active Computerized Pharmacovigilance Using Natural Language Processing, Statistics, and Electronic Health Records: A Feasibility StudyJournal of the American Medical Informatics Association, 2009
- An Electronic Health Record Based on Structured NarrativeJournal of the American Medical Informatics Association, 2008
- The interaction of domain knowledge and linguistic structure in natural language processing: interpreting hypernymic propositions in biomedical textJournal of Biomedical Informatics, 2003
- A new approach to causal inference in mortality studies with a sustained exposure period—application to control of the healthy worker survivor effectMathematical Modelling, 1986
- Male-Female Wage Differentials in Urban Labor MarketsInternational Economic Review, 1973