Corpus Development for Affective Video Indexing
- 10 February 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 16 (4), 1075-1089
- https://doi.org/10.1109/tmm.2014.2305573
Abstract
Affective video indexing is the area of research that develops techniques to automatically generate descriptions of video content that encode the emotional reactions which the video content evokes in viewers. This paper provides a set of corpus development guidelines based on state-of-the-art practice intended to support researchers in this field. Affective descriptions can be used for video search and browsing systems offering users affective perspectives. The paper is motivated by the observation that affective video indexing has yet to fully profit from the standard corpora (data sets) that have benefited conventional forms of video indexing. Affective video indexing faces unique challenges, since viewer-reported affective reactions are difficult to assess. Moreover affect assessment efforts must be carefully designed in order to both cover the types of affective responses that video content evokes in viewers and also capture the stable and consistent aspects of these responses. We first present background information on affect and multimedia and related work on affective multimedia indexing, including existing corpora. Three dimensions emerge as critical for affective video corpora, and form the basis for our proposed guidelines: the context of viewer response, personal variation among viewers, and the effectiveness and efficiency of corpus creation. Finally, we present examples of three recent corpora and discuss how these corpora make progressive steps towards fulfilling the guidelines.Keywords
Other Versions
This publication has 51 references indexed in Scilit:
- The scholarly impact of TRECVid (2003-2009)Journal of the American Society for Information Science and Technology, 2011
- The role of user mood in movie recommendationsExpert Systems with Applications, 2010
- Mixed affective responses to music with conflicting cuesCognition and Emotion, 2008
- Concept-Based Video RetrievalFoundations and Trends® in Information Retrieval, 2007
- Content-based multimedia information retrievalACM Transactions on Multimedia Computing, Communications, and Applications, 2006
- Measuring emotion: The self-assessment manikin and the semantic differentialJournal of Behavior Therapy and Experimental Psychiatry, 1994
- Studying the emotion-antecedent appraisal process: An expert system approachCognition and Emotion, 1993
- Affect Grid: A single-item scale of pleasure and arousal.Journal of Personality and Social Psychology, 1989
- A circumplex model of affect.Journal of Personality and Social Psychology, 1980
- Evidence for a three-factor theory of emotionsJournal of Research in Personality, 1977