Multi-modal data fusion for pain intensity assessment and classification
- 1 November 2017
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA)
Abstract
In this work, an assessment of several fusion architectures is undertaken within the scope of the development of a pain intensity classification system. The assessment is based on the recently recorded SenseEmotion Database [1], which consists of several individuals subjected to three gradually increasing levels of pain intensity, induced through temperature elevation (heat stimulation) under controlled conditions. Several modalities, including audio, video, respiration, electrocardiography, electromyography and electrodermal activity, were synchronously recorded during the experiments. A broad spectrum of descriptors is extracted from each of the involved modalities, followed by an assessment of the combination of the extracted descriptors through several fusion architectures. Experimental validation suggests that the choice of an appropriate fusion architecture, which is able to significantly improve over the performance of the best single modality, mainly depends on the amount of data available for the training of the classification architecture.Keywords
This publication has 19 references indexed in Scilit:
- Ensemble Methods for Continuous Affect RecognitionPublished by Association for Computing Machinery (ACM) ,2015
- Multimodal Data Fusion for Person-Independent, Continuous Estimation of Pain IntensityCommunications in Computer and Information Science, 2015
- Pain Intensity Recognition Rates via Biopotential Feature Patterns with Support Vector MachinesPLOS ONE, 2015
- P011. The use of electronic pain diaries via telemedicine for managing chronic pain.The Journal of Headache and Pain, 2015
- cvxEDA: a Convex Optimization Approach to Electrodermal Activity ProcessingIEEE Transactions on Biomedical Engineering, 2015
- Bio-Visual Fusion for Person-Independent Recognition of Pain IntensityPublished by Springer Science and Business Media LLC ,2015
- Recent developments in openSMILE, the munich open-source multimedia feature extractorPublished by Association for Computing Machinery (ACM) ,2013
- Multi-Modal Classifier-Fusion for the Recognition of EmotionsPublished by Taylor & Francis Ltd ,2013
- Variable selection using random forestsPattern Recognition Letters, 2010
- The structure, reliability and validity of pain expression: Evidence from patients with shoulder painPain, 2008