Usability Evaluation of a Clinical Decision Support System for Geriatric ED Pain Treatment
- 1 January 2016
- journal article
- Published by Georg Thieme Verlag KG in Applied Clinical Informatics
- Vol. 07 (01), 128-142
- https://doi.org/10.4338/aci-2015-08-ra-0108
Abstract
Summary Older adults are at risk for inadequate emergency department (ED) pain care. Unrelieved acute pain is associated with poor outcomes. Clinical decision support systems (CDSS) hold promise to improve patient care, but CDSS quality varies widely, particularly when usability evaluation is not employed. To conduct an iterative usability and redesign process of a novel geriatric abdominal pain care CDSS. We hypothesized this process would result in the creation of more usable and favorable pain care interventions. Thirteen emergency physicians familiar with the Electronic Health Record (EHR) in use at the study site were recruited. Over a 10-week period, 17 1-hour usability test sessions were conducted across 3 rounds of testing. Participants were given 3 patient scenarios and provided simulated clinical care using the EHR, while interacting with the CDSS interventions. Quantitative System Usability Scores (SUS), favorability scores and qualitative narrative feedback were collected for each session. Using a multi-step review process by an interdisciplinary team, positive and negative usability issues in effectiveness, efficiency, and satisfaction were considered, prioritized and incorporated in the iterative redesign process of the CDSS. Video analysis was used to determine the appropriateness of the CDS appearances during simulated clinical care. Over the 3 rounds of usability evaluations and subsequent redesign processes, mean SUS progressively improved from 74.8 to 81.2 to 88.9; mean favorability scores improved from 3.23 to 4.29 (1 worst, 5 best). Video analysis revealed that, in the course of the iterative redesign processes, rates of physicians’ acknowledgment of CDS interventions increased, however most rates of desired actions by physicians (such as more frequent pain score updates) decreased. The iterative usability redesign process was instrumental in improving the usability of the CDSS; if implemented in practice, it could improve geriatric pain care. The usability evaluation process led to improved acknowledgement and favorability. Incorporating usability testing when designing CDSS interventions for studies may be effective to enhance clinician use.Keywords
This publication has 29 references indexed in Scilit:
- Older US Emergency Department Patients Are Less Likely to Receive Pain Medication Than Younger Patients: Results From a National SurveyAnnals of Emergency Medicine, 2012
- The Quality of Emergency Department Pain Care for Older Adult PatientsJournal of the American Geriatrics Society, 2010
- Randomized clinical trial of a customized electronic alert requiring an affirmative response compared to a control group receiving a commercial passive CPOE alert: NSAID--warfarin co-prescribing as a test caseJournal of the American Medical Informatics Association, 2010
- Increasing the Detection and Response to Adherence Problems with Cardiovascular Medication in Primary Care through Computerized Drug Management Systems: A Randomized Controlled TrialMedical Decision Making, 2009
- Effect of Computerized Provider Order Entry with Clinical Decision Support on Adverse Drug Events in the Long‐Term Care SettingJournal of the American Geriatrics Society, 2008
- Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to successBMJ, 2005
- The impact of post-operative pain on outcomes following hip fracturePain, 2003
- The Impact of Postoperative Pain on the Development of Postoperative DeliriumAnesthesia & Analgesia, 1998
- The Impact of Postoperative Pain on the Development of Postoperative DeliriumAnesthesia & Analgesia, 1998
- Cognitive status and postoperative pain: Older adultsJournal of Pain and Symptom Management, 1994