Ranking-Based Emotion Recognition for Music Organization and Retrieval
- 9 August 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Audio, Speech, and Language Processing
- Vol. 19 (4), 762-774
- https://doi.org/10.1109/tasl.2010.2064164
Abstract
Determining the emotion of a song that best characterizes the affective content of the song is a challenging issue due to the difficulty of collecting reliable ground truth data and the semantic gap between human's perception and the music signal of the song. To address this issue, we represent an emotion as a point in the Cartesian space with valence and arousal as the dimensions and determine the coordinates of a song by the relative emotion of the song with respect to other songs. We also develop an RBF-ListNet algorithm to optimize the ranking-based objective function of our approach. The cognitive load of annotation, the accuracy of emotion recognition, and the subjective quality of the proposed approach are extensively evaluated. Experimental results show that this ranking-based approach simplifies emotion annotation and enhances the reliability of the ground truth. The performance of our algorithm for valence recognition reaches 0.326 in Gamma statistic.Keywords
This publication has 39 references indexed in Scilit:
- A Web-Based Game for Collecting Music MetadataJournal of New Music Research, 2008
- Automatic Emotion Prediction of Song Excerpts: Index Construction, Algorithm Design, and Empirical ComparisonJournal of New Music Research, 2007
- On the construction and training of reformulated radial basis function neural networksIEEE Transactions on Neural Networks, 2003
- Musical genre classification of audio signalsIEEE Transactions on Speech and Audio Processing, 2002
- A computationally efficient multipitch analysis modelIEEE Transactions on Speech and Audio Processing, 2000
- 10.1162/153244303322753616Applied Physics Letters, 2000
- Cue utilization in communication of emotion in music performance: Relating performance to perception.Journal of Experimental Psychology: Human Perception and Performance, 2000
- Support-vector networksMachine Learning, 1995
- Approximation capability to functions of several variables, nonlinear functionals, and operators by radial basis function neural networksIEEE Transactions on Neural Networks, 1995
- A circumplex model of affect.Journal of Personality and Social Psychology, 1980