A statistical model for synthesis of detailed facial geometry
- 1 July 2006
- journal article
- conference paper
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 25 (3), 1025-1034
- https://doi.org/10.1145/1141911.1141988
Abstract
Detailed surface geometry contributes greatly to the visual realism of 3D face models. However, acquiring high-resolution face geometry is often tedious and expensive. Consequently, most face models used in games, virtual reality, or computer vision look unrealistically smooth. In this paper, we introduce a new statistical technique for the analysis and synthesis of small three-dimensional facial features, such as wrinkles and pores. We acquire high-resolution face geometry for people across a wide range of ages, genders, and races. For each scan, we separate the skin surface details from a smooth base mesh using displaced subdivision surfaces. Then, we analyze the resulting displacement maps using the texture analysis/synthesis framework of Heeger and Bergen, adapted to capture statistics that vary spatially across a face. Finally, we use the extracted statistics to synthesize plausible detail on face meshes of arbitrary subjects. We demonstrate the effectiveness of this method in several applications, including analysis of facial texture in subjects with different ages and genders, interpolation between high-resolution face scans, adding detail to low-resolution face scans, and adjusting the apparent age of faces. In all cases, we are able to re-produce fine geometric details consistent with those observed in high resolution scans.Keywords
This publication has 19 references indexed in Scilit:
- Level Set Segmentation With Multiple RegionsIEEE Transactions on Image Processing, 2006
- A lighting reproduction approach to live-action compositingACM Transactions on Graphics, 2002
- Image analogiesPublished by Association for Computing Machinery (ACM) ,2001
- Real-time, Photo-Realistic, Physically Based Rendering of Fine Scale Human Skin StructureEurographics, 2001
- Acquiring the reflectance field of a human facePublished by Association for Computing Machinery (ACM) ,2000
- Normal meshesPublished by Association for Computing Machinery (ACM) ,2000
- A morphable model for the synthesis of 3D facesPublished by Association for Computing Machinery (ACM) ,1999
- An anthropometric face model using variational techniquesPublished by Association for Computing Machinery (ACM) ,1998
- Pyramid-based texture analysis/synthesisPublished by Association for Computing Machinery (ACM) ,1995
- A butterfly subdivision scheme for surface interpolation with tension controlACM Transactions on Graphics, 1990