Structure-Preserving Sparse Decomposition for Facial Expression Analysis
- 17 June 2014
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 23 (8), 3590-3603
- https://doi.org/10.1109/tip.2014.2331141
Abstract
Although facial expressions can be decomposed in terms of action units (AUs) as suggested by the facial action coding system, there have been only a few attempts that recognize expression using AUs and their composition rules. In this paper, we propose a dictionary-based approach for facial expression analysis by decomposing expressions in terms of AUs. First, we construct an AU-dictionary using domain experts' knowledge of AUs. To incorporate the high-level knowledge regarding expression decomposition and AUs, we then perform structure-preserving sparse coding by imposing two layers of grouping over AU-dictionary atoms as well as over the test image matrix columns. We use the computed sparse code matrix for each expressive face to perform expression decomposition and recognition. Since domain experts' knowledge may not always be available for constructing an AU-dictionary, we also propose a structure-preserving dictionary learning algorithm, which we use to learn a structured dictionary as well as divide expressive faces into several semantic regions. Experimental results on publicly available expression data sets demonstrate the effectiveness of the proposed approach for facial expression analysis.Keywords
Funding Information
- Army Research Office through the Multidisciplinary University Research Initiative Project (W911NF-09-1-0383)
This publication has 28 references indexed in Scilit:
- Multi-layer group sparse coding — For concurrent image classification and annotationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Action unit detection using sparse appearance descriptors in space-time video volumesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expressionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2010
- Action unit detection with segment-based SVMsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2010
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse ProblemsSIAM Journal on Imaging Sciences, 2009
- The Group Lasso for Logistic RegressionJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- Combined Support Vector Machines and Hidden Markov Models for Modeling Facial Action Temporal DynamicsPublished by Springer Science and Business Media LLC ,2007
- Fully Automatic Facial Action Unit Detection and Temporal AnalysisPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Web-Based Database for Facial Expression AnalysisPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Applications of second-order cone programmingLinear Algebra and its Applications, 1998