A Hierarchical Probabilistic Framework for Recognizing Learners’ Interaction Experience Trends and Emotions
Open Access
- 1 January 2014
- journal article
- research article
- Published by Hindawi Limited in Advances in Human-Computer Interaction
- Vol. 2014, 1-16
- https://doi.org/10.1155/2014/632630
Abstract
We seek to model the users’ experience within an interactive learning environment. More precisely, we are interested in assessing the relationship between learners’ emotional reactions and three trends in the interaction experience, namely,flow: the optimal interaction (a perfect immersion within the task),stuck: the nonoptimal interaction (a difficulty to maintain focused attention), andoff-task: the noninteraction (a dropout from the task). We propose a hierarchical probabilistic framework using a dynamic Bayesian network to model this relationship and to simultaneously recognize the probability of experiencing each trend as well as the emotional responses occurring subsequently. The framework combines three modalitydiagnostic variablesthat sense the learner’s experience including physiology, behavior, and performance,predictive variablesthat represent the current context and the learner’s profile, and adynamic structurethat tracks the evolution of the learner’s experience. An experimental study, with a specifically designed protocol for eliciting the targeted experiences, was conducted to validate our approach. Results revealed that multiple concurrent emotions can be associated with the experiences of flow, stuck, and off-task and that the same trend can be expressed differently from one individual to another. The evaluation of the framework showed promising results in predicting learners’ experience trends and emotional responses.Keywords
Funding Information
- Natural Sciences and Engineering Research Council of Canada
This publication has 47 references indexed in Scilit:
- The painful face – Pain expression recognition using active appearance modelsImage and Vision Computing, 2009
- Affect-aware tutors: recognising and responding to student affectInternational Journal of Learning Technology, 2009
- Toward an understanding of flow in video gamesComputers in Entertainment, 2008
- Pervasive game flowComputers in Entertainment, 2007
- GameFlowComputers in Entertainment, 2005
- How does one know whether a person understands a device? The quality of the questions the person asks when the device breaks down.Journal of Educational Psychology, 2003
- Emotion, Decision Making and the Orbitofrontal CortexCerebral Cortex, 2000
- The emotion probe: Studies of motivation and attention.American Psychologist, 1995
- Looking at pictures: Affective, facial, visceral, and behavioral reactionsPsychophysiology, 1993
- Organizational Stress, Job Satisfaction and Job Performance: Where Do We Go From Here?Journal of Management, 1992