Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction.
Top Cited Papers
- 1 June 2003
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 5, 53
- https://doi.org/10.1109/cvprw.2003.10057
Abstract
Computer animated agents and robots bring a social dimension to human computer interaction and force us to think in new ways about how computers could be used in daily life. Face to face communication is a real-time process operating at a a time scale in the order of 40 milliseconds. The level of uncertainty at this time scale is considerable, making it necessary for humans and machines to rely on sensory rich perceptual primitives rather than slow symbolic inference processes. In this paper we present progress on one such perceptual primitive. The system automatically detects frontal faces in the video stream and codes them with respect to 7 dimensions in real time: neutral, anger, disgust, fear, joy, sadness, surprise. The face finder employs a cascade of feature detectors trained with boosting techniques [15, 2]. The expression recognizer receives image patches located by the face detector. A Gabor representation of the patch is formed and then processed by a bank of SVM classifiers. A novel combination of Adaboost and SVM's enhances performance. The system was tested on the Cohn-Kanade dataset of posed facial expressions [6]. The generalization performance to new subjects for a 7- way forced choice correct. Most interestingly the outputs of the classifier change smoothly as a function of time, providing a potentially valuable representation to code facial expression dynamics in a fully automatic and unobtrusive manner. The system has been deployed on a wide variety of platforms including Sony's Aibo pet robot, ATR's RoboVie, and CU animator, and is currently being evaluated for applications including automatic reading tutors, assessment of human-robot interaction.Keywords
This publication has 9 references indexed in Scilit:
- Comprehensive database for facial expression analysisPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Classifying facial attributes using a 2-D Gabor wavelet representation and discriminant analysisPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A Comparison of Face Detection AlgorithmsLecture Notes in Computer Science, 2002
- Robovie: an interactive humanoid robotIndustrial Robot: the international journal of robotics research and application, 2001
- Automatic analysis of facial expressions: the state of the artIeee Transactions On Pattern Analysis and Machine Intelligence, 2000
- Additive logistic regression: a statistical view of boosting (With discussion and a rejoinder by the authors)The Annals of Statistics, 2000
- Neural network-based face detectionIeee Transactions On Pattern Analysis and Machine Intelligence, 1998
- Example-based learning for view-based human face detectionIeee Transactions On Pattern Analysis and Machine Intelligence, 1998
- Distortion invariant object recognition in the dynamic link architectureIEEE Transactions on Computers, 1993