Multiview face capture using polarized spherical gradient illumination
- 12 December 2011
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 30 (6), 1-10
- https://doi.org/10.1145/2070781.2024163
Abstract
We present a novel process for acquiring detailed facial geometry with high resolution diffuse and specular photometric information from multiple viewpoints using polarized spherical gradient illumination. Key to our method is a new pair of linearly polarized lighting patterns which enables multiview diffuse-specular separation under a given spherical illumination condition from just two photographs. The patterns -- one following lines of latitude and one following lines of longitude -- allow the use of fixed linear polarizers in front of the cameras, enabling more efficient acquisition of diffuse and specular albedo and normal maps from multiple viewpoints. In a second step, we employ these albedo and normal maps as input to a novel multi-resolution adaptive domain message passing stereo reconstruction algorithm to create high resolution facial geometry. To do this, we formulate the stereo reconstruction from multiple cameras in a commonly parameterized domain for multiview reconstruction. We show competitive results consisting of high-resolution facial geometry with relightable reflectance maps using five DSLR cameras. Our technique scales well for multiview acquisition without requiring specialized camera systems for sensing multiple polarization states.Keywords
Funding Information
- Division of Information and Intelligent Systems (IIS-1016703)
This publication has 18 references indexed in Scilit:
- Comprehensive Facial Performance CaptureComputer Graphics Forum, 2011
- Circularly polarized spherical illumination reflectometryACM Transactions on Graphics, 2010
- High resolution passive facial performance captureACM Transactions on Graphics, 2010
- High-quality single-shot capture of facial geometryACM Transactions on Graphics, 2010
- The Digital Emily Project: Achieving a Photorealistic Digital ActorIEEE Computer Graphics and Applications, 2010
- Facial performance synthesis using deformation-driven polynomial displacement mapsPublished by Association for Computing Machinery (ACM) ,2008
- Multi-scale capture of facial geometry and motionACM Transactions on Graphics, 2007
- Convergent Tree-Reweighted Message Passing for Energy MinimizationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006
- Spacetime stereo: a unifying framework for depth from triangulationIeee Transactions On Pattern Analysis and Machine Intelligence, 2005
- Acquiring the reflectance field of a human facePublished by Association for Computing Machinery (ACM) ,2000