Statistical Learning of Facial Expressions Improves Realism of Animated Avatar Faces
Open Access
- 12 April 2021
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Virtual Reality
Abstract
A high realism of avatars is beneficial for virtual reality experiences such as avatar-mediated communication and embodiment. Previous work, however, suggested that the usage of realistic virtual faces can lead to unexpected and undesired effects, including phenomena like the uncanny valley. This work investigates the role of photographic and behavioral realism of avatars with animated facial expressions on perceived realism and congruence ratings. More specifically, we examine ratings of photographic and behavioral realism and their mismatch in differently created avatar faces. Furthermore, we utilize these avatars to investigate the effect of behavioral realism on perceived congruence between video-recorded physical person’s expressions and their imitations by the avatar. We compared two types of avatars, both with four identities that were created from the same facial photographs. The first type of avatars contains expressions that were designed by an artistic expert. The second type contains expressions that were statistically learned from a 3D facial expression database. Our results show that the avatars containing learned facial expressions were rated more photographically and behaviorally realistic and possessed a lower mismatch between the two dimensions. They were also perceived as more congruent to the video-recorded physical person’s expressions. We discuss our findings and the potential benefit of avatars with learned facial expressions for experiences in virtual reality and future research on enfacement.Keywords
Funding Information
- Deutsche Forschungsgemeinschaft (HI 1780/5-1 ZA 592/5-1)
This publication has 59 references indexed in Scilit:
- Sensory realism and mediated aggression in video gamesComputers in Human Behavior, 2012
- Interactive region-based linear 3D face modelsACM Transactions on Graphics, 2011
- Virtual gestures: embodiment and nonverbal behavior in computer-mediated communicationPublished by Cambridge University Press (CUP) ,2011
- Example-based facial riggingACM Transactions on Graphics, 2010
- A Note on Directional Dependence in Regression SettingCommunications in Statistics - Theory and Methods, 2005
- Digital ChameleonsPsychological Science, 2005
- Emotion and sociable humanoid robotsInternational Journal of Human-Computer Studies, 2003
- Growth Modeling Using Random Coefficient Models: Model Building, Testing, and IllustrationsOrganizational Research Methods, 2002
- SHAPE ANALYSIS OF SYMMETRIC STRUCTURES: QUANTIFYING VARIATION AMONG INDIVIDUALS AND ASYMMETRYEvolution, 2002
- TARGET ARTICLE: Immersive Virtual Environment Technology as a Methodological Tool for Social PsychologyPsychological Inquiry, 2002