Development and preliminary evidence for the validity of an instrument assessing implementation of human-factors principles in medication-related decision-support systems--I-MeDeSA
Open Access
- 1 December 2011
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 18 (Supplement), i62-i72
- https://doi.org/10.1136/amiajnl-2011-000362
Abstract
Background Medication-related decision support can reduce the frequency of preventable adverse drug events. However, the design of current medication alerts often results in alert fatigue and high over-ride rates, thus reducing any potential benefits. Methods The authors previously reviewed human-factors principles for relevance to medication-related decision support alerts. In this study, instrument items were developed for assessing the appropriate implementation of these human-factors principles in drug–drug interaction (DDI) alerts. User feedback regarding nine electronic medical records was considered during the development process. Content validity, construct validity through correlation analysis, and inter-rater reliability were assessed. Results The final version of the instrument included 26 items associated with nine human-factors principles. Content validation on three systems resulted in the addition of one principle ( Corrective Actions) to the instrument and the elimination of eight items. Additionally, the wording of eight items was altered. Correlation analysis suggests a direct relationship between system age and performance of DDI alerts (p=0.0016). Inter-rater reliability indicated substantial agreement between raters (κ=0.764). Conclusion The authors developed and gathered preliminary evidence for the validity of an instrument that measures the appropriate use of human-factors principles in the design and display of DDI alerts. Designers of DDI alerts may use the instrument to improve usability and increase user acceptance of medication alerts, and organizations selecting an electronic medical record may find the instrument helpful in meeting their clinicians' usability needs.Keywords
This publication has 18 references indexed in Scilit:
- Factors influencing alert acceptance: a novel approach for predicting the success of clinical decision supportJournal of the American Medical Informatics Association, 2011
- A Computerized Provider Order Entry Intervention for Medication Safety During Acute Kidney Injury: A Quality Improvement ReportAmerican Journal of Kidney Diseases, 2010
- Health information technology: fallacies and sober realitiesJournal of the American Medical Informatics Association, 2010
- A review of human factors principles for the design and implementation of medication safety alerts in clinical information systemsJournal of the American Medical Informatics Association, 2010
- From the EditorQuality Management in Health Care, 2010
- Tiering Drug-Drug Interaction Alerts by Severity Increases Compliance RatesJournal of the American Medical Informatics Association, 2009
- Medication-related Clinical Decision Support in Computerized Provider Order Entry Systems: A ReviewJournal of the American Medical Informatics Association, 2007
- Improving Acceptance of Computerized Prescribing Alerts in Ambulatory CareJournal of the American Medical Informatics Association, 2006
- Behavioural implications of alarm mistrust as a function of task workloadErgonomics, 2000
- Human probability matching behaviour in response to alarms of varying reliabilityErgonomics, 1995