Learning Multiscale Active Facial Patches for Expression Analysis
- 29 September 2014
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 45 (8), 1499-1510
- https://doi.org/10.1109/tcyb.2014.2354351
Abstract
In this paper, we present a new idea to analyze facial expression by exploring some common and specific information among different expressions. Inspired by the observation that only a few facial parts are active in expression disclosure (e.g., around mouth, eye), we try to discover the common and specific patches which are important to discriminate all the expressions and only a particular expression, respectively. A two-stage multitask sparse learning (MTSL) framework is proposed to efficiently locate those discriminative patches. In the first stage MTSL, expression recognition tasks are combined to located common patches. Each of the tasks aims to find dominant patches for each expression. Secondly, two related tasks, facial expression recognition and face verification tasks, are coupled to learn specific facial patches for individual expression. The two-stage patch learning is performed on patches sampled by multiscale strategy. Extensive experiments validate the existence and significance of common and specific patches. Utilizing these learned patches, we achieve superior performances on expression recognition compared to the state-of-the-arts.Keywords
This publication has 55 references indexed in Scilit:
- Towards robust and effective shape modeling: Sparse shape compositionMedical Image Analysis, 2012
- Social signal processing: Survey of an emerging domainImage and Vision Computing, 2009
- Facial expression recognition based on Local Binary Patterns: A comprehensive studyImage and Vision Computing, 2009
- An Interior-Point Method for Large-Scale -Regularized Least SquaresIEEE Journal of Selected Topics in Signal Processing, 2007
- Learning From Examples in the Small Sample Case: Face Expression RecognitionIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2005
- Automatic facial expression analysis: a surveyPattern Recognition, 2003
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Recognizing action units for facial expression analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Automatic classification of single facial imagesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1999
- Matching pursuits with time-frequency dictionariesIEEE Transactions on Signal Processing, 1993