Automated Facial Expression Classification and affect interpretation using infrared measurement of facial skin temperature variations
- 1 September 2006
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Autonomous and Adaptive Systems
- Vol. 1 (1), 91-113
- https://doi.org/10.1145/1152934.1152939
Abstract
Machines would require the ability to perceive and adapt to affects for achieving artificial sociability. Most autonomous systems use Automated Facial Expression Classification (AFEC) and Automated Affect Interpretation (AAI) to achieve sociability. Varying lighting conditions, occlusion, and control over physiognomy can influence the real life performance of vision-based AFEC systems. Physiological signals provide complementary information for AFEC and AAI. We employed transient facial thermal features for AFEC and AAI. Infrared thermal images with participants' normal expression and intentional expressions of happiness, sadness, disgust, and fear were captured. Facial points that undergo significant thermal changes with a change in expression termed as Facial Thermal Feature Points (FTFPs) were identified. Discriminant analysis was invoked on principal components derived from the Thermal Intensity Values (TIVs) recorded at the FTFPs. The cross-validation and person-independent classification respectively resulted in 66.28% and 56.0% success rates. Classification significance tests suggest that (1) like other physiological cues, facial skin temperature also provides useful information about affective states and their facial expression; (2) patterns of facial skin temperature variation can complement other cues for AFEC and AAI; and (3) infrared thermal imaging may help achieve artificial sociability in robots and autonomous systems.Keywords
This publication has 33 references indexed in Scilit:
- Guide to BiometricsPublished by Springer Science and Business Media LLC ,2004
- Facial expression recognition from video sequences: temporal and static modelingComputer Vision and Image Understanding, 2003
- How Convincing is Mr. Data's Smile: Affective Expressions of MachinesUser Modelling and User-Adapted Interaction, 2001
- Classifying facial actionsIeee Transactions On Pattern Analysis and Machine Intelligence, 1999
- Interacting with virtual humans through body actionsIEEE Computer Graphics and Applications, 1998
- Machine Interpretation of Facial ExpressionsBT Technology Journal, 1998
- Getting to know each other—Artificial social intelligence for autonomous robotsRobotics and Autonomous Systems, 1995
- Facial expression and emotion.American Psychologist, 1993
- Comparison of Stopping Rules in Forward Stepwise Discriminant AnalysisJournal of the American Statistical Association, 1979
- Facial Action Coding SystemPublished by American Psychological Association (APA) ,1978