Building a Natural Language Processing Tool to Identify Patients With High Clinical Suspicion for Kawasaki Disease from Emergency Department Notes
Open Access
- 30 January 2016
- journal article
- research article
- Published by Wiley in Academic Emergency Medicine
- Vol. 23 (5), 628-636
- https://doi.org/10.1111/acem.12925
Abstract
Objective Delayed diagnosis of Kawasaki disease (KD) may lead to serious cardiac complications. We sought to create and test the performance of a natural language processing (NLP) tool, the KD‐NLP, in the identification of emergency department (ED) patients for whom the diagnosis of KD should be considered. Methods We developed an NLP tool that recognizes the KD diagnostic criteria based on standard clinical terms and medical word usage using 22 pediatric ED notes augmented by Unified Medical Language System vocabulary. With high suspicion for KD defined as fever and three or more KD clinical signs, KD‐NLP was applied to 253 ED notes from children ultimately diagnosed with either KD or another febrile illness. We evaluated KD‐NLP performance against ED notes manually reviewed by clinicians and compared the results to a simple keyword search. Results KD‐NLP identified high‐suspicion patients with a sensitivity of 93.6% and specificity of 77.5% compared to notes manually reviewed by clinicians. The tool outperformed a simple keyword search (sensitivity = 41.0%; specificity = 76.3%). Conclusions KD‐NLP showed comparable performance to clinician manual chart review for identification of pediatric ED patients with a high suspicion for KD. This tool could be incorporated into the ED electronic health record system to alert providers to consider the diagnosis of KD. KD‐NLP could serve as a model for decision support for other conditions in the ED.Keywords
Funding Information
- Patient-Centered Outcomes Research Institute (CDRN-1306-04819)
- National Institutes of Health (U54HL108460)
This publication has 33 references indexed in Scilit:
- Prevalence of Kawasaki Disease in Young Adults With Suspected Myocardial IschemiaCirculation, 2012
- iDASH: integrating data for analysis, anonymization, and sharingJournal of the American Medical Informatics Association, 2012
- A diagnostic algorithm combining clinical and molecular data distinguishes Kawasaki disease from other febrile illnessesBMC Medicine, 2011
- Mapping clinical phenotype data elements to standardized metadata repositories and controlled terminologies: the eMERGE Network experienceJournal of the American Medical Informatics Association, 2011
- 2010 i2b2/VA challenge on concepts, assertions, and relations in clinical textJournal of the American Medical Informatics Association, 2011
- Electronic Medical Records for Genetic Research: Results of the eMERGE ConsortiumScience Translational Medicine, 2011
- Extracting medication information from clinical textJournal of the American Medical Informatics Association, 2010
- When Children With Kawasaki Disease Grow Up: Myocardial and Vascular Complications in AdulthoodJournal of the American College of Cardiology, 2009
- Fever detection from free-text clinical records for biosurveillanceJournal of Biomedical Informatics, 2004
- The Treatment of Kawasaki Syndrome with Intravenous Gamma GlobulinThe New England Journal of Medicine, 1986