A comparison of two approaches to text processing: facilitating chart reviews of radiology reports in electronic medical records.
- 1 October 2010
- journal article
- research article
- Vol. 7, 1a
Abstract
Chart review is central to health services research. Text processing, which analyzes free-text fields through automated methods, can facilitate this process. We compared precision and accuracy of NegEx and SQLServer 2008 Free-Text Search in identifying acute fractures in radiology reports.The term "fracture" was included in 23,595 radiology reports from the Veterans Aging Cohort Study. Four hundred reports were randomly selected and manually reviewed for acute fractures to establish a gold standard. Reports were then processed by SQLServer and NegEx. Results were compared to the gold standard to determine accuracy, precision, recall, and F-statistic.NegEx and the gold standard identified acute fractures in 13 reports. SQLServer identified 2 in a report-based analysis (precision: 1.00; accuracy: 0.97; recall: 0.15; F-statistic: 0.26), and 12 in a sentence-by-sentence analysis (precision: 1.00; recall: 0.92; accuracy: 0.92; F-statistic: 0.96).Text-processing tools utilizing basic database or programming skills are comparable, precise, and accurate in identifying reports for review.This publication has 10 references indexed in Scilit:
- ConText: An algorithm for determining negation, experiencer, and temporal status from clinical reportsJournal of Biomedical Informatics, 2009
- Veterans Aging Cohort Study (VACS)Medical Care, 2006
- Evaluating the effectiveness of four contextual features in classifying annotated clinical conditions in emergency department reports.2006
- The Kappa Statistic in Reliability Studies: Use, Interpretation, and Sample Size RequirementsPTJ: Physical Therapy & Rehabilitation Journal, 2005
- Use of General-purpose Negation Detection to Augment Concept Indexing of Medical Documents: A Quantitative Study Using the UMLSJournal of the American Medical Informatics Association, 2001
- A Simple Algorithm for Identifying Negated Findings and Diseases in Discharge SummariesJournal of Biomedical Informatics, 2001
- Evaluation of negation phrases in narrative clinical reports.2001
- Factors associated with successful answering of clinical questions using an information retrieval system.2000
- How Well Do Physicians Use Electronic Information Retrieval Systems?Published by American Medical Association (AMA) ,1998
- A General Natural-language Text Processor for Clinical RadiologyJournal of the American Medical Informatics Association, 1994