Automatic Emotion Recognition from Facial Expressions when Wearing a Mask
- 11 July 2021
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
Abstract
People communicate emotions through several nonverbal channels and facial expressions play an important part in this communicative process. Automatic Facial Expression Recognition (FER) is a very hot topic that has attracted a lot of interest in the last years. Most FER systems try to recognize emotions from the entire face of a person. Unfortunately, due to pandemic situation, people wear a mask most of the time, thus their faces are not fully visible. In our study, we investigate the effectiveness of a FER system in recognizing emotions only from the eyes region, which is the sole visible region when wearing a mask by comparing the results of the same approach when applied to the entire face. The proposed pipeline involves several steps: detecting a face in an image, detecting a mask on a face, extracting the eyes region, and recognize the emotion expressed on the basis of such region. As it was expected, emotions that are related mainly to the mouth region (e.g. disgust) are not recognized at all and positive emotions are the ones that are better determined by considering only the region of the eyes.Keywords
This publication has 10 references indexed in Scilit:
- Face masks reduce emotion-recognition accuracy and perceived closenessPLOS ONE, 2021
- Facial Expression Recognition with the advent of face masksPublished by Association for Computing Machinery (ACM) ,2020
- Wearing Face Masks Strongly Confuses Counterparts in Reading EmotionsFrontiers in Psychology, 2020
- Detecting Learning Affect in E-Learning Platform Using Facial Emotion ExpressionPublished by Springer Science and Business Media LLC ,2020
- Enhancing Game Experience with Facial Expression Recognition as Dynamic BalancingProcedia Computer Science, 2019
- MobileNetV2: Inverted Residuals and Linear BottlenecksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2018
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Shades of emotion: What the addition of sunglasses or masks to faces reveals about the development of facial expression processingCognition, 2012
- Driver drowsiness detection using face expression recognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Facial expressions as game input with different emotional feedback conditionsPublished by Association for Computing Machinery (ACM) ,2008