Electronic Versus Manual Data Processing: Evaluating the Use of Electronic Health Records in Out‐of‐hospital Clinical Research
Open Access
- 9 February 2012
- journal article
- research article
- Published by Wiley in Academic Emergency Medicine
- Vol. 19 (2), 217-227
- https://doi.org/10.1111/j.1553-2712.2011.01275.x
Abstract
ACADEMIC EMERGENCY MEDICINE 2012; 19:217–227 © 2012 by the Society for Academic Emergency Medicine Abstract Objectives: The objective was to compare case ascertainment, agreement, validity, and missing values for clinical research data obtained, processed, and linked electronically from electronic health records (EHR) compared to “manual” data processing and record abstraction in a cohort of out‐of‐hospital trauma patients. Methods: This was a secondary analysis of two sets of data collected for a prospective, population‐based, out‐of‐hospital trauma cohort evaluated by 10 emergency medical services (EMS) agencies transporting to 16 hospitals, from January 1, 2006, through October 2, 2007. Eighteen clinical, operational, procedural, and outcome variables were collected and processed separately and independently using two parallel data processing strategies by personnel blinded to patients in the other group. The electronic approach included EHR data exports from EMS agencies, reformatting, and probabilistic linkage to outcomes from local trauma registries and state discharge databases. The manual data processing approach included chart matching, data abstraction, and data entry by a trained abstractor. Descriptive statistics, measures of agreement, and validity were used to compare the two approaches to data processing. Results: During the 21‐month period, 418 patients underwent both data processing methods and formed the primary cohort. Agreement was good to excellent (kappa = 0.76 to 0.97; intraclass correlation coefficient [ICC] = 0.49 to 0.97), with exact agreement in 67% to 99% of cases and a median difference of zero for all continuous and ordinal variables. The proportions of missing out‐of‐hospital values were similar between the two approaches, although electronic processing generated more missing outcomes (87 of 418, 21%, 95% confidence interval [CI] = 17% to 25%) than the manual approach (11 of 418, 3%, 95% CI = 1% to 5%). Case ascertainment of eligible injured patients was greater using electronic methods (n = 3,008) compared to manual methods (n = 629). Conclusions: In this sample of out‐of‐hospital trauma patients, an all‐electronic data processing strategy identified more patients and generated values with good agreement and validity compared to traditional data collection and processing methods.This publication has 29 references indexed in Scilit:
- A Novel Method to Link and Validate Routinely Collected Emergency Department Clinical Data to Measure Quality of CareAmerican Journal of Medical Quality, 2009
- The Resuscitation Outcomes Consortium Epistry-Trauma: Design, development, and implementation of a North American Epidemiologic Prehospital Trauma RegistryResuscitation, 2008
- Quantifying Data Quality for Clinical Trials Using Electronic Data CapturePLOS ONE, 2008
- Sensible approaches for reducing clinical trial costsClinical Trials, 2008
- Advanced Statistics: Missing Data in Clinical Research—Part 2: Multiple ImputationAcademic Emergency Medicine, 2007
- Advanced Statistics: Missing Data in Clinical Research--Part 2: Multiple ImputationAcademic Emergency Medicine, 2007
- The Validity of Using Multiple Imputation for Missing Out‐of‐hospital Data in a State Trauma RegistryAcademic Emergency Medicine, 2006
- Validation of Probabilistic Linkage to Match De‐identified Ambulance Records to a State Trauma RegistryAcademic Emergency Medicine, 2006
- Prospective validation of a new model for evaluating emergency medical services systems by in-field observation of specific time intervals in prehospital careAnnals of Emergency Medicine, 1993
- STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENTThe Lancet, 1986