A Method for Analyzing Learning Sentiment Based on Classroom Time-Series Images
Open Access
- 22 May 2023
- journal article
- research article
- Published by Hindawi Limited in Mathematical Problems in Engineering
- Vol. 2023, 1-13
- https://doi.org/10.1155/2023/6955772
Abstract
With the development of smart classrooms, analyzing students’ emotions for classroom learning is an effective means of accurately capturing their learning process. Although facial expression-based emotion analysis methods are effective in analyzing classroom learning emotions, current research focuses on facial expressions and does not consider the fact that expressions in different postures do not represent the same emotions. To provide a continuous and deeper understanding of students’ learning emotions, this study proposes an algorithm to characterize learning emotions based on classroom time-series image data. First, face expression data for classroom scenarios are established to address the lack of expression databases in real teaching environments. Second, to improve the accuracy of facial expression recognition, a residual channel cross transformer masking net expression recognition model is proposed in this paper. Finally, to address the problem that the existing research dimension of learning emotion is too single, this paper uses the facial expression and head posture data obtained from deep learning models for fusion analysis and innovatively proposes a Dempster–Shafer evidence-theoretic fusion model to characterize the learning emotion within the lecture duration of knowledge points. The experiments show that both the proposed expression recognition model and the learning sentiment analysis algorithm have good performance, with the expression recognition model achieving an accuracy of 73.58% on the FER2013 dataset. The proposed learning emotion analysis method provides technical support for holistic analysis of student learning effects and evaluation of students’ level of understanding of the knowledge points.Keywords
Funding Information
- National Natural Science Foundation of China (62177012, 61967005, 62267003, 2021YCXS033, CRKL190107, 2021KY0212)
This publication has 22 references indexed in Scilit:
- Combined forecasting model with CEEMD-LCSS reconstruction and the ABC-SVR method for landslide displacement predictionJournal of Cleaner Production, 2021
- Recognition of Students’ Mental States in Discussion Based on Multimodal Data and its Application to Educational SupportIEEE Access, 2021
- Facial expression recognition method with multi-label distribution learning for non-verbal behavior understanding in the classroomInfrared Physics & Technology, 2020
- An Automatic Recognition Method for Students’ Classroom Behaviors Based on Image ProcessingTraitement du Signal, 2020
- Predicting Students' Attention Level with Interpretable Facial and Head Dynamic Features in an Online Tutoring System (Student Abstract)Proceedings of the AAAI Conference on Artificial Intelligence, 2020
- Emotion recognition using multimodal deep learning in multiple psychophysiological signals and videoInternational Journal of Machine Learning and Cybernetics, 2020
- A Micro-expression Recognition Algorithm for Students in Classroom Learning Based on Convolutional Neural NetworkTraitement du Signal, 2019
- Classroom Attention Analysis Based on Multiple Euler Angles Constraint and Head Pose EstimationPublished by Springer Science and Business Media LLC ,2019
- Face Alignment in Full Pose Range: A 3D Total SolutionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Emotion Regulation in Adolescent Well-Being and Positive EducationJournal of Happiness Studies, 2017