Generating Erroneous Human Behavior From Strategic Knowledge in Task Models and Evaluating Its Impact on System Safety With Model Checking
Open Access
- 23 May 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Vol. 43 (6), 1314-1327
- https://doi.org/10.1109/tsmc.2013.2256129
Abstract
Human-automation interaction, including erroneous human behavior, is a factor in the failure of complex, safety-critical systems. This paper presents a method for automatically generating formal task analytic models encompassing both erroneous and normative human behavior from normative task models, where the misapplication of strategic knowledge is used to generate erroneous behavior. Resulting models can be automatically incorporated into larger formal system models so that safety properties can be formally verified with a model checker. This allows analysts to prove that a human-automation interactive system (as represented by the formal model) will or will not satisfy safety properties with both normative and generated erroneous human behavior. Benchmarks are reported that illustrate how this method scales. The method is then illustrated with a case study: the programming of a patient-controlled analgesia pump. In this example, a problem resulting from a generated erroneous human behavior is discovered. The method is further employed to evaluate the effectiveness of different solutions to the discovered problem. The results and future research directions are discussed.Keywords
This publication has 48 references indexed in Scilit:
- Using Model Checking to Explore Checklist-Guided Pilot BehaviorThe International Journal of Aviation Psychology, 2012
- Formally verifying human–automation interaction as part of a system model: limitations and tradeoffsInnovations in Systems and Software Engineering, 2010
- A Method for the Formal Verification of Human-interactive SystemsProceedings of the Human Factors and Ergonomics Society Annual Meeting, 2009
- Formal and experimental validation approaches in HCI systems design based on a shared event B modelInternational Journal on Software Tools for Technology Transfer, 2006
- Safety-relevant mode confusions—modelling and reducing themReliability Engineering & System Safety, 2005
- Human-Automation InteractionReviews of Human Factors and Ergonomics, 2005
- Architecture and Development Environment of a Knowledge-Based Monitor That Facilitate Incremental Knowledge-Base DevelopmentIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 2004
- Models of interactive systems: a case study on programmable user modellingInternational Journal of Human-Computer Studies, 2004
- Preventing user errors by systematic analysis of deviations from the system task modelInternational Journal of Human-Computer Studies, 2002
- The ‘problem ’ with automation: inappropriate feedback and interaction, not ‘over-automation’Philosophical Transactions of the Royal Society of London. B, Biological Sciences, 1990