A Deformable 3-D Facial Expression Model for Dynamic Human Emotional State Recognition
- 6 June 2012
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 23 (1), 142-157
- https://doi.org/10.1109/tcsvt.2012.2203210
Abstract
Automatic emotion recognition from facial expression is one of the most intensively researched topics in affective computing and human-computer interaction. However, it is well known that due to the lack of 3-D feature and dynamic analysis the functional aspect of affective computing is insufficient for natural interaction. In this paper, we present an automatic emotion recognition approach from video sequences based on a fiducial point controlled 3-D facial model. The facial region is first detected with local normalization in the input frames. The 26 fiducial points are then located on the facial region and tracked through the video sequences by multiple particle filters. Depending on the displacement of the fiducial points, they may be used as landmarked control points to synthesize the input emotional expressions on a generic mesh model. As a physics-based transformation, elastic body spline technology is introduced to the facial mesh to generate a smooth warp that reflects the control point correspondences. This also extracts the deformation feature from the realistic emotional expressions. Discriminative Isomap-based classification is used to embed the deformation feature into a low dimensional manifold that spans in an expression space with one neutral and six emotion class centers. The final decision is made by computing the nearest class center of the feature space.This publication has 32 references indexed in Scilit:
- Automatic face detection in video sequences using local normalization and optimal adaptive correlation techniquesPattern Recognition, 2009
- Facial Expression Recognition Using 3D Facial Feature DistancesLecture Notes in Computer Science, 2007
- Fully Automatic Facial Feature Point Detection Using Gabor Feature Based Boosted ClassifiersPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Learning From Examples in the Small Sample Case: Face Expression RecognitionIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2005
- Constructing and Fitting Active Appearance Models With OcclusionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Evaluation of Expression Recognition TechniquesLecture Notes in Computer Science, 2003
- Image morphing of facial images transformation based on Navier elastic body splinesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Elastic body splines: a physics based approach to coordinate transformation in medical image matchingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A Global Geometric Framework for Nonlinear Dimensionality ReductionScience, 2000
- A physics-based coordinate transformation for 3-D image matchingIEEE Transactions on Medical Imaging, 1997