Facial Action Recognition for Facial Expression Analysis From Static Face Images
- 18 May 2004
- journal article
- clinical trial
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics)
- Vol. 34 (3), 1449-1461
- https://doi.org/10.1109/tsmcb.2004.825931
Abstract
Automatic recognition of facial gestures (i.e., facial muscle activity) is rapidly becoming an area of intense interest in the research field of machine vision. In this paper, we present an automated system that we developed to recognize facial gestures in static, frontal- and/or profile-view color face images. A multidetector approach to facial feature localization is utilized to spatially sample the profile contour and the contours of the facial components such as the eyes and the mouth. From the extracted contours of the facial features, we extract ten profile-contour fiducial points and 19 fiducial points of the contours of the facial components. Based on these, 32 individual facial muscle actions (AUs) occurring alone or in combination are recognized using rule-based reasoning. With each scored AU, the utilized algorithm associates a factor denoting the certainty with which the pertinent AU has been scored. A recognition rate of 86% is achieved.Keywords
This publication has 22 references indexed in Scilit:
- Toward an affect-sensitive multimodal human-computer interactionProceedings of the IEEE, 2003
- Model-based face tracking for view-independent facial expression recognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Facial action recognition in face profile image sequencesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- A real-time face trackerPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A hybrid approach to mouth features detectionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Detecting faces in images: A surveyIeee Transactions On Pattern Analysis and Machine Intelligence, 2001
- Automatic analysis of facial expressions: the state of the artIeee Transactions On Pattern Analysis and Machine Intelligence, 2000
- Expert system for automatic analysis of facial expressionsImage and Vision Computing, 2000
- What's basic about basic emotions?Psychological Review, 1990
- The expression of the emotions in man and animals.Published by American Psychological Association (APA) ,1872