Intelligent Agent Transparency in Human–Agent Teaming for Multi-UxV Management
Top Cited Papers
Open Access
- 11 February 2016
- journal article
- Published by SAGE Publications in Human Factors: The Journal of the Human Factors and Ergonomics Society
- Vol. 58 (3), 401-415
- https://doi.org/10.1177/0018720815621206
Abstract
Objective: We investigated the effects of level of agent transparency on operator performance, trust, and workload in a context of human–agent teaming for multirobot management. Background: Participants played the role of a heterogeneous unmanned vehicle (UxV) operator and were instructed to complete various missions by giving orders to UxVs through a computer interface. An intelligent agent (IA) assisted the participant by recommending two plans—a top recommendation and a secondary recommendation—for every mission. Method: A within-subjects design with three levels of agent transparency was employed in the present experiment. There were eight missions in each of three experimental blocks, grouped by level of transparency. During each experimental block, the IA was incorrect three out of eight times due to external information (e.g., commander’s intent and intelligence). Operator performance, trust, workload, and usability data were collected. Results: Results indicate that operator performance, trust, and perceived usability increased as a function of transparency level. Subjective and objective workload data indicate that participants’ workload did not increase as a function of transparency. Furthermore, response time did not increase as a function of transparency. Conclusion: Unlike previous research, which showed that increased transparency resulted in increased performance and trust calibration at the cost of greater workload and longer response time, our results support the benefits of transparency for performance effectiveness without additional costs. Application: The current results will facilitate the implementation of IAs in military settings and will provide useful data to the design of heterogeneous UxV teams.Keywords
This publication has 39 references indexed in Scilit:
- The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual searchThe Quarterly Journal of Experimental Psychology, 2009
- The benefits of imperfect diagnostic automation: a synthesis of the literatureTheoretical Issues in Ergonomics Science, 2007
- Human-Automation Collaboration in Dynamic Mission Planning: A Challenge Requiring an Ecological ApproachProceedings of the Human Factors and Ergonomics Society Annual Meeting, 2006
- Working memory span tasks: A methodological review and user’s guidePsychonomic Bulletin & Review, 2005
- A dissociation between mental rotation and perspective-taking spatial abilitiesIntelligence, 2004
- Trust in Automation: Designing for Appropriate RelianceHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2004
- Eta Squared, Partial Eta Squared, and Misreporting of Effect Size in Communication ResearchHuman Communication Research, 2002
- Working Memory, Metacognitive Uncertainty, and Belief Bias in Syllogistic ReasoningThe Quarterly Journal of Experimental Psychology Section A, 2000
- Humans and Automation: Use, Misuse, Disuse, AbuseHuman Factors: The Journal of the Human Factors and Ergonomics Society, 1997
- The role of visual attention in saccadic eye movementsPerception & Psychophysics, 1995