Hospital Facebook Reviews Analysis Using a Machine Learning Sentiment Analyzer and Quality Classifier
Open Access
- 3 December 2021
- journal article
- research article
- Published by MDPI AG in Healthcare
- Vol. 9 (12), 1679
- https://doi.org/10.3390/healthcare9121679
Abstract
While experts have recognised the significance and necessity of social media integration in healthcare, no systematic method has been devised in Malaysia or Southeast Asia to include social media input into the hospital quality improvement process. The goal of this work is to explain how to develop a machine learning system for classifying Facebook reviews of public hospitals in Malaysia by using service quality (SERVQUAL) dimensions and sentiment analysis. We developed a Machine Learning Quality Classifier (MLQC) based on the SERVQUAL model and a Machine Learning Sentiment Analyzer (MLSA) by manually annotated multiple batches of randomly chosen reviews. Logistic regression (LR), naive Bayes (NB), support vector machine (SVM), and other methods were used to train the classifiers. The performance of each classifier was tested using 5-fold cross validation. For topic classification, the average F1-score was between 0.687 and 0.757 for all models. In a 5-fold cross validation of each SERVQUAL dimension and in sentiment analysis, SVM consistently outperformed other methods. The study demonstrates how to use supervised learning to automatically identify SERVQUAL domains and sentiments from patient experiences on a hospital’s Facebook page. Malaysian healthcare providers can gather and assess data on patient care via the use of these content analysis technology to improve hospital quality of care.Funding Information
- Universiti Sains Malaysia (203/PPSP/6171293)
This publication has 56 references indexed in Scilit:
- Use of Sentiment Analysis for Capturing Patient Experience From Free-Text Comments Posted OnlineJournal of Medical Internet Research, 2013
- A New Dimension of Health Care: Systematic Review of the Uses, Benefits, and Limitations of Social Media for Health CommunicationJournal of Medical Internet Research, 2013
- Feasibility of Real-Time Satisfaction Surveys Through Automated Analysis of Patients' Unstructured Comments and SentimentsQuality Management in Health Care, 2012
- Is there an association between hospital accreditation and patient satisfaction with hospital care? A survey of 37 000 patients treated by 73 hospitalsInternational Journal for Quality in Health Care, 2011
- Private healthcare quality: applying a SERVQUAL modelInternational Journal of Health Care Quality Assurance, 2010
- Measuring Service Quality of Public Dental Health Care Facilities in Kelantan, MalaysiaAsia-Pacific journal of public health, 2010
- Development, Implementation, and Public Reporting of the HCAHPS SurveyMedical Care Research and Review, 2009
- A review of twenty years of SERVQUAL researchInternational Journal of Quality and Service Sciences, 2009
- ErratumAsian Journal on Quality, 2009
- Service quality in hospitals: more favourable than you might thinkManaging Service Quality: An International Journal, 2003