Video Analytics for Customer Emotion and Satisfaction at Contact Centers
- 2 May 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Human-Machine Systems
- Vol. 48 (3), 266-278
- https://doi.org/10.1109/thms.2017.2695613
Abstract
Due to the high levels of competition in a global market, companies have put more emphasis on building strong customer relationships and increasing customer satisfaction levels. With technological improvements in information and communication technologies, a highly anticipated key contributor to improve the customer experience and satisfaction in service episodes is through the application of video analytics, such as to evaluate the customers emotions over the full service cycle. Currently, emotion recognition from video is a challenging research area. One of the most effective solutions to address this challenge is to utilize both the audio and visual components as two sources contained in the video data to make an overall assessment of the emotion. The combined use of audio and visual data sources presents additional challenges, such as determining the optimal data fusion technique prior to classification. In this paper, we propose an audio–visual emotion recognition system to detect the universal six emotions (happy, angry, sad, disgust, surprise, and fear) from video data. The detected customer emotions are then mapped and translated to give customer satisfaction scores. The proposed customer satisfaction video analytics system can operate over video conferencing or video chat. The effectiveness of our proposal is verified through numerical results.Keywords
This publication has 53 references indexed in Scilit:
- Towards Efficient Multi-Modal Emotion RecognitionInternational Journal of Advanced Robotic Systems, 2013
- Speech AnalyticsPublished by Wiley ,2011
- Customer value anticipation, customer satisfaction and loyalty: An empirical examinationIndustrial Marketing Management, 2011
- Optimized data fusion for K-means Laplacian clusteringBioinformatics, 2010
- Customer Experience Creation: Determinants, Dynamics and Management StrategiesJournal of Retailing, 2009
- Customer relationship management: Finding value driversIndustrial Marketing Management, 2008
- New measurement scales for evaluating perceptions of the technology‐mediated customer service experienceJournal of Operations Management, 2004
- Key factors in the successful application of quality function deployment (QFD)IEEE Transactions on Engineering Management, 2001
- RASTA processing of speechIEEE Transactions on Speech and Audio Processing, 1994
- Eigenfaces for RecognitionJournal of Cognitive Neuroscience, 1991