Minimizing Illumination Differences for 3D to 2D Face Recognition Using Lighting Maps
- 3 December 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 44 (5), 725-736
- https://doi.org/10.1109/tcyb.2013.2291196
Abstract
Asymmetric 3D to 2D face recognition has gained attention from the research community since the real-world application of 3D to 3D recognition is limited by the unavailability of inexpensive 3D data acquisition equipment. A 3D to 2D face recognition system explicitly relies on 3D facial data to account for uncontrolled image conditions related to head pose or illumination. We build upon such a system, which matches relit gallery textures with pose-normalized probe images, using the gallery facial meshes. The relighting process, however, is based on an assumption of indoor lighting conditions and limits recognition performance on outdoor images. In this paper, we propose a novel method for minimizing illumination difference by unlighting a 3D face texture via albedo estimation using lighting maps. The algorithm is evaluated on challenging databases (UHDB30, UHDB11, FRGC v2.0) with drastic lighting and pose variations. The experimental results demonstrate the robustness of our method for estimating the albedo from both indoor and outdoor captured images, and the effectiveness and efficiency for illumination normalization in face recognition.Keywords
This publication has 35 references indexed in Scilit:
- Facial landmark detection in uncontrolled conditionsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Passive Multimodal 2-D+3-D Face Recognition Using Gabor Features and Landmark DistancesIEEE Transactions on Information Forensics and Security, 2011
- Unconstrained Pose-Invariant Face Recognition Using 3D Generic Elastic ModelsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- Robust FFT-Based Scale-Invariant Image Registration with Image GradientsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2010
- Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting ConditionsIEEE Transactions on Image Processing, 2010
- Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model ApproachIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Analysis of human faces using a measurement-based skin reflectance modelPublished by Association for Computing Machinery (ACM) ,2006
- What Is the Set of Images of an Object Under All Possible Illumination Conditions?International Journal of Computer Vision, 1998
- The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow FieldsComputer Vision and Image Understanding, 1996
- Illumination for computer generated picturesCommunications of the ACM, 1975