Real-time facial animation with image-based dynamic avatars
- 11 July 2016
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 35 (4), 1-12
- https://doi.org/10.1145/2897824.2925873
Abstract
We present a novel image-based representation for dynamic 3D avatars, which allows effective handling of various hairstyles and headwear, and can generate expressive facial animations with finescale details in real-time. We develop algorithms for creating an image-based avatar from a set of sparsely captured images of a user, using an off-the-shelf web camera at home. An optimization method is proposed to construct a topologically consistent morphable model that approximates the dynamic hair geometry in the captured images. We also design a real-time algorithm for synthesizing novel views of an image-based avatar, so that the avatar follows the facial motions of an arbitrary actor. Compelling results from our pipeline are demonstrated on a variety of cases.Keywords
This publication has 56 references indexed in Scilit:
- Realtime performance-based facial animationACM Transactions on Graphics, 2011
- High-quality passive facial performance capture using anchor framesACM Transactions on Graphics, 2011
- Leveraging motion capture and 3D scanning for high-fidelity facial performance acquisitionACM Transactions on Graphics, 2011
- A practical appearance model for dynamic facial colorACM Transactions on Graphics, 2010
- Example-based facial riggingACM Transactions on Graphics, 2010
- View and Time Interpolation in Image SpaceComputer Graphics Forum, 2008
- Hair photoboothACM Transactions on Graphics, 2008
- Subspace gradient domain mesh deformationACM Transactions on Graphics, 2006
- Face transfer with multilinear modelsACM Transactions on Graphics, 2005
- Spacetime facesACM Transactions on Graphics, 2004