Facial Expression Recognition Using Pose-Guided Face Alignment and Discriminative Features Based on Deep Learning
Open Access
- 7 May 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 9, 69267-69277
- https://doi.org/10.1109/access.2021.3078258
Abstract
Face expression recognition is a key technology of robot vision, which can help the robotic understand human emotions. However, interference from the real-world, such as light changes, face occlusion, and pose variation, reduces the recognition rate of the model. To solve above problems, in this paper, a novel deep model is proposed to improve the classification accuracy of facial expressions. The proposed model has the following merits: 1) A pose-guided face alignment method is proposed to reduce the intra-class difference, which can overcome the impact of environmental noise; 2) A hybrid feature representation method is proposed to obtain high-level discriminative facial features that achieves better results in classification networks; 3) A lightweight fusion backbone is designed, which combines the VGG-16 and the ResNet to achieve low-data and low-calculation training. Finally, to evaluate the proposed model, we conduct a series of experiments on four benchmark datasets, including the CK+, the JAFFE, the Oulu-CASIA, and the AR. The results show that the proposed model achieves state-of-the-art recognition rates, that is, 98.9%, 96.8%, 94.5%, and 98.7%, respectively. Comparing with the traditional methods and other advanced deep learning methods, the proposed model can comparable performance in a variety of tasks.Keywords
Funding Information
- Liaoning Provincial Natural Fund Guidance Program Projects (2019-ZD-0251, 2019-ZD-0249)
This publication has 58 references indexed in Scilit:
- Multimodal learning for facial expression recognitionPattern Recognition, 2015
- Automated facial expression recognition based on histograms of oriented gradient feature vector differencesSignal, Image and Video Processing, 2015
- AU-inspired Deep Networks for Facial Expression Feature LearningNeurocomputing, 2015
- Effective semantic features for facial expressions recognition using SVMMultimedia Tools and Applications, 2015
- Human Facial Expression Recognition Using Stepwise Linear Discriminant Analysis and Hidden Conditional Random FieldsIEEE Transactions on Image Processing, 2015
- Automatic facial expression recognition using features of salient facial patchesIEEE Transactions on Affective Computing, 2014
- Learning Multiscale Active Facial Patches for Expression AnalysisIEEE Transactions on Cybernetics, 2014
- PCA-based dictionary building for accurate facial expression recognition via sparse representationJournal of Visual Communication and Image Representation, 2014
- A new facial expression recognition based on curvelet transform and online sequential extreme learning machine initialized with spherical clusteringNeural Computing & Applications, 2014
- Facial expression recognition based on Local Binary Patterns: A comprehensive studyImage and Vision Computing, 2009