Pose-Invariant 3D Face Alignment
- 1 December 2015
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in 2015 IEEE International Conference on Computer Vision (ICCV)
- p. 3694-3702
- https://doi.org/10.1109/iccv.2015.421
Abstract
Face alignment aims to estimate the locations of a set of landmarks for a given image. This problem has received much attention as evidenced by the recent advancement in both the methodology and performance. However, most of the existing works neither explicitly handle face images with arbitrary poses, nor perform large-scale experiments on non-frontal and profile face images. In order to address these limitations, this paper proposes a novel face alignment algorithm that estimates both 2D and 3D landmarks and their 2D visibilities for a face image with an arbitrary pose. By integrating a 3D point distribution model, a cascaded coupled-regressor approach is designed to estimate both the camera projection matrix and the 3D landmarks. Furthermore, the 3D model also allows us to automatically estimate the 2D landmark visibilities via surface normal. We use a substantially larger collection of all-pose face images to evaluate our algorithm and demonstrate superior performances than the state-of-the-art methods.Keywords
This publication has 33 references indexed in Scilit:
- Face Alignment by Explicit Shape RegressionInternational Journal of Computer Vision, 2013
- Continuous Regression for Non-rigid Image AlignmentLecture Notes in Computer Science, 2012
- Learning a generic 3D face model from 2D image databases using incremental Structure-from-MotionImage and Vision Computing, 2010
- Video-based face model fitting using Adaptive Active Appearance ModelImage and Vision Computing, 2010
- IMAGE BASED 3D FACE RECONSTRUCTION: A SURVEYInternational Journal of Image and Graphics, 2009
- Shape Regression MachineLecture Notes in Computer Science, 2007
- Generic vs. person specific active appearance modelsImage and Vision Computing, 2005
- Active Appearance Models RevisitedInternational Journal of Computer Vision, 2004
- Active appearance modelsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Active Shape Models-Their Training and ApplicationComputer Vision and Image Understanding, 1995