Evaluating Clinical Decision Support Systems: Monitoring CPOE Order Check Override Rates in the Department of Veterans Affairs' Computerized Patient Record System
Open Access
- 1 September 2008
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 15 (5), 620-626
- https://doi.org/10.1197/jamia.m2453
Abstract
Objective: To measure critical order check override rates in VA Puget Sound Health Care System's computerized practitioner order entry (CPOE) system and to compare 2006 results to a similar 2001 study. Design: Analysis of ordering and order check data gathered by a post-hoc logging program. Use of Pearson's chi-square contingency table test comparing results from this study and the earlier study. Measurements: Factors measured were total number of orders, frequency of order check types, frequency of order check overrides by order check type and comparisons of these results with previous results. Results: A total of 37,040 orders generated 908 (2.5%) critical order checks. Drug-drug critical alert override rate was 74/85 (87%) in 2006 compared to 95/108 (88%) in 2001 (X2=0.04, df=1, p=0.85). The drug-allergy override rate was 341/420 (81%) compared to 72/105 (69%) in 2001 (X2=7.97, df=1, p=0.005). In 2001, 0.25% (105/42,621) orders generated a drug-allergy order check compared to 1.13% (420/37,040) in 2006 (X2=238.45, df=1, pConclusion: Override rates of critical drug-drug and drug-allergy order checks remain high at VA Puget Sound Health Care System including significant increases in drug-allergy order checks. We recommend that monitoring override rates be regular practice in clinical computing systems and conclude that qualitative research should be carried out to better understand how physicians interact with decision support at the point of ordering.This publication has 14 references indexed in Scilit:
- Practitioners' Views on Computerized Drug--Drug Interaction Alerts in the VA SystemJournal of the American Medical Informatics Association, 2007
- Implementing a Commercial Rule Base as a Medication Order Safety NetJournal of the American Medical Informatics Association, 2005
- Clinical Relevance of Automated Drug Alerts From the Perspective of Medical ProvidersAmerican Journal of Medical Quality, 2005
- Characteristics and Consequences of Drug Allergy Alert Overrides in a Computerized Physician Order Entry SystemJournal of the American Medical Informatics Association, 2004
- Physicians' Decisions to Override Computerized Drug Alerts in Primary CareArchives of Internal Medicine, 2003
- VistA—U.S. Department of Veterans Affairs national-scale HISInternational Journal of Medical Informatics, 2002
- Characteristics and override rates of order checks in a practitioner order entry system.2002
- Reducing the Frequency of Errors in Medicine Using Information TechnologyJournal of the American Medical Informatics Association, 2001
- Improving allergy alerting in a computerized physician order entry system.2000
- The transition to automated practitioner order entry in a teaching hospital: the VA Puget Sound experience.1999