Probabilistic Elastic Matching for Pose Variant Face Verification
- 1 June 2013
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in 2013 IEEE Conference on Computer Vision and Pattern Recognition
- p. 3499-3506
- https://doi.org/10.1109/cvpr.2013.449
Abstract
Pose variation remains to be a major challenge for real-world face recognition. We approach this problem through a probabilistic elastic matching method. We take a part based representation by extracting local features (e.g., LBP or SIFT) from densely sampled multi-scale image patches. By augmenting each feature with its location, a Gaussian mixture model (GMM) is trained to capture the spatial-appearance distribution of all face images in the training corpus. Each mixture component of the GMM is confined to be a spherical Gaussian to balance the influence of the appearance and the location terms. Each Gaussian component builds correspondence of a pair of features to be matched between two faces/face tracks. For face verification, we train an SVM on the vector concatenating the difference vectors of all the feature pairs to decide if a pair of faces/face tracks is matched or not. We further propose a joint Bayesian adaptation algorithm to adapt the universally trained GMM to better model the pose variations between the target pair of faces/face tracks, which consistently improves face verification accuracy. Our experiments show that our method outperforms the state-of-the-art in the most restricted protocol on Labeled Face in the Wild (LFW) and the YouTube video face database by a significant margin.Keywords
This publication has 22 references indexed in Scilit:
- An associate-predict model for face recognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Describable Visual Attributes for Face Verification and Image SearchIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- A Study on Universal Background Model Training in Speaker VerificationIEEE Transactions on Audio, Speech, and Language Processing, 2011
- How far can you get with a modern face recognition test set using only simple features?Published by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Learning Visual Similarity Measures for Comparing Never Seen ObjectsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Unsupervised Joint Alignment of Complex ImagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Discriminative Training of Hyper-feature Models for Object IdentificationPublished by British Machine Vision Association and Society for Pattern Recognition ,2006
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Growing Gaussian mixture models for pose invariant face recognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- From few to many: illumination cone models for face recognition under variable lighting and poseIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001