Facial Expression Recognition Using 3D Points Aware Deep Neural Network
- 30 April 2021
- journal article
- research article
- Published by International Information and Engineering Technology Association in Traitement du Signal
- Vol. 38 (2), 321-330
- https://doi.org/10.18280/ts.380209
Abstract
Point cloud-based Deep Neural Networks (DNNs) have gained increasing attention as an insightful solution in the study field of geometric deep learning. Point set aware DNNs have proven capable of dealing with the unstructured data type and successful in 3D data applications such as 3D object classification, segmentation and recognition. On the other hand, two major challenges remain understudied when it comes to the use of point cloud-based DNNs for 3D facial expression (FE) recognition. The first challenge is the lack of large labelled 3D facial data. The second is how to obtain a point-based discriminative representation of 3D faces. To address the first issue, we suggest to enlarge the used dataset by generating synthetic 3D FEs. For the second one, we propose to apply a level-curve based sampling strategy in order to exploit crucial geometric information. The conducted experiments show promising results reaching 97.23% on the enlarged BU-3DFE dataset.Keywords
This publication has 17 references indexed in Scilit:
- Unsupervised Domain Adaptation with Regularized Optimal Transport for Multimodal 2D+3D Facial Expression RecognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2018
- Accurate Facial Parts Localization and Deep Learning for 3D Facial Expression RecognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2018
- Facial Expression Recognition via Joint Deep Learning of RGB-Depth Map Latent RepresentationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2017
- Shape Completion Using 3D-Encoder-Predictor CNNs and Shape SynthesisPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2017
- End-to-End 3D Face Reconstruction with Deep Neural NetworksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2017
- Multimodal 2D+3D Facial Expression Recognition With Deep Fusion Convolutional Neural NetworkIEEE Transactions on Multimedia, 2017
- 3D Face Reconstruction by Learning from Synthetic DataPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- A Deep Neural Network-Driven Feature Learning Method for Multi-view Facial Expression RecognitionIEEE Transactions on Multimedia, 2016
- Blue‐Noise Remeshing with Farthest Point OptimizationComputer Graphics Forum, 2014
- Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model ApproachIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007