Enhancing Student Models in Game-based Learning with Facial Expression Recognition
- 9 July 2017
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM) in Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization
- p. 192-201
- https://doi.org/10.1145/3079628.3079686
Abstract
Recent years have seen a growing recognition of the role that affect plays in learning. Because game-based learning environments elicit a wide range of student affective states, affect-enhanced student modeling for game-based learning holds considerable promise. This paper introduces an affect-enhanced student modeling framework that leverages facial expression tracking for game-based learning. The affect-enhanced student modeling framework was used to generate predictive models of student learning and student engagement for students who interacted with CRYSTAL ISLAND, a game-based learning environment for microbiology education. Findings from the study reveal that the affect-enhanced student models significantly outperform baseline predictive student models that utilize the same gameplay traces but do not use facial expression tracking. The study also found that models based on individual facial action coding units are more effective than composite emotion models. The findings suggest that introducing facial expression tracking can improve the accuracy of student models, both for predicting student learning gains and also for predicting student engagement.Keywords
Funding Information
- Social Sciences and Humanities Research Council of Canada (SSHRC 895-2011-1006)
This publication has 27 references indexed in Scilit:
- Confusion can be beneficial for learningLearning and Instruction, 2014
- Affect and Engagement in Game-BasedLearning EnvironmentsIEEE Transactions on Affective Computing, 2013
- A meta-analysis of the cognitive and motivational effects of serious games.Journal of Educational Psychology, 2013
- AutoTutor and affective autotutorACM Transactions on Interactive Intelligent Systems, 2012
- A review of recent advances in learner and skill modeling in intelligent learning environmentsUser Modelling and User-Adapted Interaction, 2011
- The Relative Effectiveness of Human Tutoring, Intelligent Tutoring Systems, and Other Tutoring SystemsEducational Psychologist, 2011
- Fifteen years of constraint-based tutors: what we have achieved and where we are goingUser Modelling and User-Adapted Interaction, 2011
- Affect-aware tutors: recognising and responding to student affectInternational Journal of Learning Technology, 2009
- The Factor Structure of the Presence QuestionnairePRESENCE: Virtual and Augmented Reality, 2005
- Measuring Presence in Virtual Environments: A Presence QuestionnairePRESENCE: Virtual and Augmented Reality, 1998