Classifying Affective States Using Thermal Infrared Imaging of the Human Face
- 17 November 2009
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biomedical Engineering
- Vol. 57 (4), 979-987
- https://doi.org/10.1109/tbme.2009.2035926
Abstract
In this paper, time, frequency, and time-frequency features derived from thermal infrared data are used to discriminate between self-reported affective states of an individual in response to visual stimuli drawn from the International Affective Pictures System. A total of six binary classification tasks were examined to distinguish baseline and affect states. Affect states were determined from subject-reported levels of arousal and valence. Mean adjusted accuracies of 70% to 80% were achieved for the baseline classifications tasks. Classification accuracies between high and low ratings of arousal and valence were between 50% and 60%, respectively. Our analysis showed that facial thermal infrared imaging data of baseline and other affective states may be separable. The results of this study suggest that classification of facial thermal infrared imaging data coupled with affect models can be used to provide information about an individual's affective state for potential use as a passive communication pathway.Keywords
This publication has 41 references indexed in Scilit:
- Infrared thermography as an access pathway for individuals with severe motor impairmentsJournal of NeuroEngineering and Rehabilitation, 2009
- Mutual Information as a Measure of Contextual Effects on Single Switch UseThe Open Rehabilitation Journal, 2009
- Facial skin temperature decreases in infants with joyful expressionInfant Behavior and Development, 2008
- Brain–computer interfaces: communication and restoration of movement in paralysisThe Journal of Physiology, 2007
- Investigating the stationarity of paediatric aspiration signalsIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2005
- Hybrid genetic algorithms for feature selectionIeee Transactions On Pattern Analysis and Machine Intelligence, 2004
- Sympathetic skin responseClinical Autonomic Research, 2003
- Small sample size effects in statistical pattern recognition: recommendations for practitionersIeee Transactions On Pattern Analysis and Machine Intelligence, 1991
- A circumplex model of affect.Journal of Personality and Social Psychology, 1980
- Spectral emissivity of skin and pericardiumPhysics in Medicine & Biology, 1973