A Deep Neural Network-Driven Feature Learning Method for Multi-view Facial Expression Recognition
Top Cited Papers
- 3 August 2016
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 18 (12), 2528-2536
- https://doi.org/10.1109/tmm.2016.2598092
Abstract
In this paper, a novel deep neural network (DNN)-driven feature learning method is proposed and applied to multi-view facial expression recognition (FER). In this method, scale invariant feature transform (SIFT) features corresponding to a set of landmark points are first extracted from each facial image. Then, a feature matrix consisting of the extracted SIFT feature vectors is used as input data and sent to a well-designed DNN model for learning optimal discriminative features for expression classification. The proposed DNN model employs several layers to characterize the corresponding relationship between the SIFT feature vectors and their corresponding high-level semantic information. By training the DNN model, we are able to learn a set of optimal features that are well suitable for classifying the facial expressions across different facial views. To evaluate the effectiveness of the proposed method, two nonfrontal facial expression databases, namely BU-3DFE and Multi-PIE, are respectively used to testify our method and the experimental results show that our algorithm outperforms the state-of-the-art methods.Keywords
Funding Information
- National Basic Research Program of China (2015CB351704)
- National Natural Science Foundation of China (61231002, 61572009)
- Natural Science Foundation of Jiangsu Province (BK20130020)
This publication has 25 references indexed in Scilit:
- Joint Fine-Tuning in Deep Neural Networks for Facial Expression RecognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- Learning Representative Deep Features for Image Set AnalysisIEEE Transactions on Multimedia, 2015
- Robust Face Recognition via Multimodal Deep Face RepresentationIEEE Transactions on Multimedia, 2015
- Prototype-Based Modeling for Facial Expression AnalysisIEEE Transactions on Multimedia, 2014
- 3D Convolutional Neural Networks for Human Action RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Emotion recognition using dynamic grid-based HoG featuresPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Multi-PIEImage and Vision Computing, 2010
- Emotion Recognition from Arbitrary View Facial ImagesLecture Notes in Computer Science, 2010
- Toward Practical Smile DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2009
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004