A Brief Review of Facial Emotion Recognition Based on Visual Information
Top Cited Papers
Open Access
- 30 January 2018
- Vol. 18 (2), 401
- https://doi.org/10.3390/s18020401
Abstract
Facial emotion recognition (FER) is an important topic in the fields of computer vision and artificial intelligence owing to its significant academic and commercial potential. Although FER can be conducted using multiple sensors, this review focuses on studies that exclusively use facial images, because visual expressions are one of the main information channels in interpersonal communication. This paper provides a brief review of researches in the field of FER conducted over the past decades. First, conventional FER approaches are described along with a summary of the representative categories of FER systems and their main algorithms. Deep-learning-based FER approaches using deep networks enabling “end-to-end” learning are then presented. This review also focuses on an up-to-date hybrid deep-learning approach combining a convolutional neural network (CNN) for the spatial features of an individual frame and long short-term memory (LSTM) for temporal features of consecutive frames. In the later part of this paper, a brief review of publicly available evaluation metrics is given, and a comparison with benchmark results, which are a standard for a quantitative comparison of FER researches, is described. This review can serve as a brief guidebook to newcomers in the field of FER, providing basic knowledge and a general understanding of the latest state-of-the-art studies, as well as to experienced researchers looking for productive directions for future work.Keywords
This publication has 39 references indexed in Scilit:
- CASME II: An Improved Spontaneous Micro-Expression Database and the Baseline EvaluationPLOS ONE, 2014
- Geometric Feature-Based Facial Expression Recognition in Image Sequences Using Multi-Class AdaBoost and Support Vector MachinesSensors, 2013
- Facial Expression Recognition from Infrared Thermal VideosPublished by Springer Science and Business Media LLC ,2013
- Static and dynamic 3D facial expression recognition: A comprehensive surveyImage and Vision Computing, 2012
- Robust Facial Expression Recognition via Compressive SensingSensors, 2012
- The MPI Facial Expression Database — A Validated Database of Emotional and Conversational Facial ExpressionsPLOS ONE, 2012
- Automated Facial Action Coding System for dynamic analysis of facial expressions in neuropsychiatric disordersJournal of Neuroscience Methods, 2011
- Facial expression recognition from near-infrared videosImage and Vision Computing, 2011
- Shape analysis of local facial patches for 3D facial expression recognitionPattern Recognition, 2011
- A Real-Time Facial Expression Recognition System for Online GamesInternational Journal of Computer Games Technology, 2008