Detecting depression from facial actions and vocal prosody
- 1 September 2009
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Current methods of assessing psychopathology depend almost entirely on verbal report (clinical interview or questionnaire) of patients, their family, or caregivers. They lack systematic and efficient ways of incorporating behavioral observations that are strong indicators of psychological disorder, much of which may occur outside the awareness of either individual. We compared clinical diagnosis of major depression with automatically measured facial actions and vocal prosody in patients undergoing treatment for depression. Manual FACS coding, active appearance modeling (AAM) and pitch extraction were used to measure facial and vocal expression. Classifiers using leave-one-out validation were SVM for FACS and for AAM and logistic regression for voice. Both face and voice demonstrated moderate concurrent validity with depression. Accuracy in detecting depression was 88% for manual FACS and 79% for AAM. Accuracy for vocal prosody was 79%. These findings suggest the feasibility of automatic detection of depression, raise new issues in automated facial image analysis and machine learning, and have exciting implications for clinical theory and practice.Keywords
This publication has 24 references indexed in Scilit:
- Automatic coding of facial expressions displayed during posed and genuine painImage and Vision Computing, 2009
- All Smiles are Not Created Equal: Morphology and Timing of Smiles Perceived as Amused, Polite, and Embarrassed/NervousJournal of Nonverbal Behavior, 2008
- Comparison of Deliberate and Spontaneous Facial Movement in Smiles and Eyebrow RaisesJournal of Nonverbal Behavior, 2008
- Automated video-based facial expression analysis of neuropsychiatric disordersJournal of Neuroscience Methods, 2008
- The painful facePublished by Association for Computing Machinery (ACM) ,2007
- The role of structural facial asymmetry in asymmetry of peak facial expressionsLaterality, 2006
- Facial Expression in Affective DisordersPublished by Oxford University Press (OUP) ,2005
- Active Appearance Models RevisitedInternational Journal of Computer Vision, 2004
- Vocal timing in face-to-face interaction of clinically depressed and nondepressed mothers and their 4-month-old infantsInfant Behavior and Development, 1996
- Maternal Depression and Motherese: Temporal and Intonational FeaturesChild Development, 1988