The Use of Cognitive Task Analysis to Reveal the Instructional Limitations of Experts in the Teaching of Procedural Skills
Open Access
- 1 May 2014
- journal article
- research article
- Published by Ovid Technologies (Wolters Kluwer Health) in Academic Medicine
- Vol. 89 (5), 811-816
- https://doi.org/10.1097/acm.0000000000000224
Abstract
Because of the automated nature of knowledge, experts tend to omit information when describing a task. A potential solution is cognitive task analysis (CTA). The authors investigated the percentage of knowledge experts omitted when teaching a cricothyrotomy to determine the percentage of additional knowledge gained during a CTA interview. Three experts were videotaped teaching a cricothyrotomy in 2010 at the University of Southern California. After transcription, they participated in CTA interviews for the same procedure. Three additional surgeons were recruited to perform a CTA for the procedure, and a "gold standard" task list was created. Transcriptions from the teaching sessions were compared with the task list to identify omitted steps (both "what" and "how" to do). Transcripts from the CTA interviews were compared against the task list to determine the percentage of knowledge articulated by each expert during the initial "free recall" (unprompted) phase of the CTA interview versus the amount of knowledge gained by using CTA elicitation techniques (prompted). Experts omitted an average of 71% (10/14) of clinical knowledge steps, 51% (14/27) of action steps, and 73% (3.6/5) of decision steps. For action steps, experts described "how to do it" only 13% (3.6/27) of the time. The average number of steps that were described increased from 44% (20/46) when unprompted to 66% (31/46) when prompted. This study supports previous research that experts unintentionally omit knowledge when describing a procedure. CTA is a useful method to extract automated knowledge and augment expert knowledge recall during teaching.Keywords
This publication has 13 references indexed in Scilit:
- The Use of Cognitive Task Analysis to Improve Instructional Descriptions of ProceduresJournal of Surgical Research, 2012
- The Effectiveness of a Cognitive Task Analysis Informed Curriculum to Increase Self-Efficacy and Improve Performance for an Open CricothyrotomyJournal of Surgical Education, 2011
- The use of a cognitive task analysis–based multimedia program to teach surgical decision making in flexor tendon repairThe American Journal of Surgery, 2008
- The use of cognitive task analysis to improve the learning of percutaneous tracheostomy placementThe American Journal of Surgery, 2007
- The Implications of Research on Expertise for Curriculum and PedagogyEducational Psychology Review, 2006
- Cognitive task analysis for teaching technical skills in an inanimate surgical skills laboratoryThe American Journal of Surgery, 2004
- Knowledge Encapsulation and the Intermediate EffectContemporary Educational Psychology, 2000
- Cognitive task analysis for trainingInternational Journal of Educational Research, 1996
- Percentage of procedural knowledge acquired as a function of the number of experts from whom knowledge is acquired for diagnosis, debugging, and interpretation tasksInternational Journal of Human–Computer Interaction, 1994
- The Accuracy of Verbal Reports About the Effects of Stimuli on Evaluations and BehaviorSocial Psychology, 1978