Spatially Optimized Data-Level Fusion of Texture and Shape for Face Recognition
- 18 August 2011
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 21 (2), 859-872
- https://doi.org/10.1109/tip.2011.2165218
Abstract
Data-level fusion is believed to have the potential for enhancing human face recognition. However, due to a number of challenges, current techniques have failed to achieve its full potential. We propose spatially optimized data/pixel-level fusion of 3-D shape and texture for face recognition. Fusion functions are objectively optimized to model expression and illumination variations in linear subspaces for invariant face recognition. Parameters of adjacent functions are constrained to smoothly vary for effective numerical regularization. In addition to spatial optimization, multiple nonlinear fusion models are combined to enhance their learning capabilities. Experiments on the FRGC v2 data set show that spatial optimization, higher order fusion functions, and the combination of multiple such functions systematically improve performance, which is, for the first time, higher than score-level fusion in a similar experimental setup.Keywords
This publication has 54 references indexed in Scilit:
- Nonparametric Discriminant Analysis for Face RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2009
- Locally linear discriminant embedding: An efficient method for face recognitionPattern Recognition, 2008
- Image Level Fusion Method for Multimodal 2D + 3D Face RecognitionLecture Notes in Computer Science, 2008
- 3D Face Recognition Under Expression Variations using Similarity Metrics FusionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model ApproachIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Matching 2.5D face scans to 3D modelsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- Learning to Fuse 3D+2D Based Face Recognition at Both Feature and Decision LevelsLecture Notes in Computer Science, 2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Face recognition using LDA-based algorithmsIEEE Transactions on Neural Networks, 2003
- On combining classifiersIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998