An examination of cognitive processing of multimedia information based on viewers' eye movements
- 1 December 2011
- journal article
- research article
- Published by Taylor & Francis Ltd in Interactive Learning Environments
- Vol. 19 (5), 503-517
- https://doi.org/10.1080/10494820903520123
Abstract
This study utilized qualitative and quantitative designs and eye-tracking technology to understand how viewers process multimedia information. Eye movement data were collected from eight college students (non-science majors) while they were viewing web pages containing different types of text and illustrations depicting the mechanism of atmospheric pressure and the formation of sea and land winds. The results showed that participants' eyes were fixated more often on the text than on the illustrations. Breaking the instructional multimedia into small successive segments did not seem to increase the number of eye fixations on the illustrations. Participants alternated their eye fixations on related components of the illustrations while focusing on verbs or sentences representing the kinematics of the weather systems. Text seemed to provide more detailed explanations than pictures and therefore served as the main resource for understanding the content. Scan paths revealed that participants were likely to be distracted by decorative icons in the illustrations. The decorative icons also created a split-attention effect on students' cognitive processing. Eye-tracking technology was found to be a valuable tool for achieving the objectives of this study, and it provided insights into students' cognitive processes during multimedia learning. Discussion and suggestions for instructional designers and future studies are provided.Keywords
This publication has 20 references indexed in Scilit:
- The ZAP project: designing interactive computer tools for learning psychologyInnovations in Education and Teaching International, 2006
- DeFT: A conceptual framework for considering learning with multiple representationsLearning and Instruction, 2006
- When Static Media Promote Active Learning: Annotated Illustrations Versus Narrated Animations in Multimedia Instruction.Journal of Experimental Psychology: Applied, 2005
- Dynamic visualisations and learningLearning and Instruction, 2004
- Multimedia instructions and cognitive load theory: Effects of modality and cueingBritish Journal of Educational Psychology, 2004
- When Is the Ball Going to Hit the Ground? Duration Estimates, Eye Movements, and Mental Imagery of Object Motion.Journal of Experimental Psychology: Human Perception and Performance, 2004
- Cognitive Load Measurement as a Means to Advance Cognitive Load TheoryEducational Psychologist, 2003
- Cognitive load theory, learning difficulty, and instructional designLearning and Instruction, 1994
- Constructing Mental Models of Machines from Text and DiagramsJournal of Memory and Language, 1993
- Eye fixations and cognitive processesCognitive Psychology, 1976