Representative Segment-Based Emotion Analysis and Classification with Automatic Respiration Signal Segmentation

Abstract

Human respiration has been reported as having great relevance to the emotional state. However, the respiration signal obtained using traditional biosensors not only reflects changing emotions and emotion intensities, but also contains motion artifacts. The resulting information ambiguity limits the practical application of the respiration signal as a means of reliable affective state appraisal. Thus, the present study proposes a method for extracting representative Emotion Elicited Segments (EESs) from the respiration signal such that the affective state of the individual can be more reliably determined. The EES extraction process involves the combination of the following procedures, namely, 1) Mutual Information-Based Emotion Relevance Feature Ranking based on the Dynamic Time Warping Distance (MIDTW), and 2) Constraint-based Elicited Segment Density (CESD) analysis. Due to the innate regularity of the respiration signal, the respiration pattern under a particular emotional state would be relatively quasihomogeneous over time. Accordingly, a parameter-free Respiration quasi-Homogeneity Segmentation (RHS) algorithm is proposed for partitioning the respiration signal into quasi-homogenous segments from which the EESs can then be extracted. The experimental results obtained for five prototypical emotions (i.e., “love,” “sadness,” “joy,” “anger,” and “fear”) show that the proposed segmentation/extraction methodology enables the EESs to be reliably identified and yields an average classification rate of 88 percent.