The Evaluation of a Playbook Interface for Human-Autonomy Teaming in Single Pilot Operations
- 1 September 2019
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in 2019 IEEE/AIAA 38th Digital Avionics Systems Conference (DASC)
Abstract
This paper presents preliminary results of an evaluation of a Playbook delegation interface for human-autonomy teaming (HAT) in Single Pilot Operations (SPO). In this context, autonomy is defined as a class of automation that acts with more intention and authority, and it behaves more like a team member than a tool. In SPO, there will be a single pilot who will serve as the pilot-in-command (PIC) to make all flight decisions, perform flight tasks, and collaborate with an autonomous teammate during the flight. To enable a move to SPO, an autonomous teammate would share responsibility, authority, and tasks with a human operator to achieve the mission goals. HAT is the study of how to design the functions, interaction, and skills of autonomous teammate to work best with humans as a team. A Playbook interface has been developed as a delegation interface for HAT to support the single pilot during the flights. It allows humans to express their intent to an autonomous teammate to efficiently adapt the function allocation in response to a situation. This may lead to more efficient coordination and joint team performance. The ability to delegate implies that function allocation between teammates can be dynamic and responsive to the current situation. Specifically, in HAT, the challenge in deciding the function allocation prior to and during task execution is how to enable teammates to express their intent to each other quickly and accurately. In SPO, Playbook enables the single pilot to call a template play and modify it with the collaboration of the autonomous teammate. The modification of a play allows not only the changing of task details but also allows changes in allocation between the human and the autonomous teammates. The Playbook evaluation study aims to evaluate (1) the ability of pilots to make function allocation decisions in real-time, and (2) the usability and functionality of the Playbook interface.Keywords
This publication has 13 references indexed in Scilit:
- An Evaluation of Cognitive Skill Degradation in Information AutomationProceedings of the Human Factors and Ergonomics Society Annual Meeting, 2016
- Human Performance Risks and Benefits of Adaptive Systems on the Flight DeckThe International Journal of Aviation Psychology, 2016
- Conceptual framework for single pilot operationsPublished by Association for Computing Machinery (ACM) ,2014
- A Task Analytic Process to Define Future Concepts in AviationLecture Notes in Computer Science, 2014
- Situation Awareness, Mental Workload, and Trust in Automation: Viable, Empirically Supported Cognitive Engineering ConstructsJournal of Cognitive Engineering and Decision Making, 2008
- Designing for Flexible Interaction Between Humans and Automation: Delegation Interfaces for Supervisory ControlHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2007
- The Playbook™ Approach to Adaptive AutomationProceedings of the Human Factors and Ergonomics Society Annual Meeting, 2005
- A playbook interface for mixed initiative control of multiple unmanned vehicle teamsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Humans and Automation: Use, Misuse, Disuse, AbuseHuman Factors: The Journal of the Human Factors and Ergonomics Society, 1997
- Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical ResearchPublished by Elsevier BV ,1988