Detail-Preserving Controllable Deformation from Sparse Examples
- 19 March 2012
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 18 (8), 1215-1227
- https://doi.org/10.1109/tvcg.2012.88
Abstract
Recent advances in laser scanning technology have made it possible to faithfully scan a real object with tiny geometric details, such as pores and wrinkles. However, a faithful digital model should not only capture static details of the real counterpart but also be able to reproduce the deformed versions of such details. In this paper, we develop a data-driven model that has two components; the first accommodates smooth large-scale deformations and the second captures high-resolution details. Large-scale deformations are based on a nonlinear mapping between sparse control points and bone transformations. A global mapping, however, would fail to synthesize realistic geometries from sparse examples, for highly deformable models with a large range of motion. The key is to train a collection of mappings defined over regions locally in both the geometry and the pose space. Deformable fine-scale details are generated from a second nonlinear mapping between the control points and per-vertex displacements. We apply our modeling scheme to scanned human hand models, scanned face models, face models reconstructed from multiview video sequences, and manually constructed dinosaur models. Experiments show that our deformation models, learned from extremely sparse training data, are effective and robust in synthesizing highly deformable models with rich fine features, for keyframe animation as well as performance-driven animation. We also compare our results with those obtained by alternative techniques.Keywords
This publication has 35 references indexed in Scilit:
- Interactive region-based linear 3D face modelsACM Transactions on Graphics, 2011
- Leveraging motion capture and 3D scanning for high-fidelity facial performance acquisitionACM Transactions on Graphics, 2011
- Facial performance synthesis using deformation-driven polynomial displacement mapsACM Transactions on Graphics, 2008
- Real-time data driven deformation using kernel canonical correlation analysisACM Transactions on Graphics, 2008
- Multi-scale capture of facial geometry and motionACM Transactions on Graphics, 2007
- Skinning with dual quaternionsPublished by Association for Computing Machinery (ACM) ,2007
- Inverse kinematics for reduced deformable modelsACM Transactions on Graphics, 2006
- Mesh-based inverse kinematicsACM Transactions on Graphics, 2005
- Selectively Damped Least Squares for Inverse KinematicsJournal of Graphics Tools, 2005
- Locally Weighted Regression: An Approach to Regression Analysis by Local FittingJournal of the American Statistical Association, 1988