Application of Natural Language Processing with Supervised Machine Learning Techniques to Predict the Overall Drugs Performance
- 3 May 2020
- journal article
- Published by AJIT - E Academic Journal of Information Technology in AJIT-e: Academic Journal of Information Technology
- Vol. 11 (40), 8-23
- https://doi.org/10.5824/ajite.2020.01.001.x
Abstract
Online product reviews have become a valuable source of information which facilitate customer decision with respect to a particular product. With the wealthy information regarding user's satisfaction and experiences about a particular drug, pharmaceutical companies make the use of online drug reviews to improve the quality of their products. Machine learning has enabled scientists to train more efficient models which facilitate decision making in various fields. In this manuscript we applied a drug review dataset used by (Gräβer, Kallumadi, Malberg,& Zaunseder, 2018), available freely from machine learning repository website of the University of California Irvine (UCI) to identify best machine learning model which provide a better prediction of the overall drug performance with respect to users' reviews. Apart from several manipulations done to improve model accuracy, all necessary procedures required for text analysis were followed including text cleaning and transformation of texts to numeric format for easy training machine learning models. Prior to modeling, we obtained overall sentiment scores for the reviews. Customer's reviews were summarized and visualized using a bar plot and word cloud to explore the most frequent terms. Due to scalability issues, we were able to use only the sample of the dataset. We randomly sampled 15000 observations from the 161297 training dataset and 10000 observations were randomly sampled from the 53766 testing dataset. Several machine learning models were trained using 10 folds cross-validation performed under stratified random sampling. The trained models include Classification and Regression Trees (CART), classification tree by C5.0, logistic regression (GLM), Multivariate Adaptive Regression Spline (MARS), Support vector machine (SVM) with both radial and linear kernels and a classification tree using random forest (Random Forest). Model selection was done through a comparison of accuracies and computational efficiency. Support vector machine (SVM) with linear kernel was significantly best with an accuracy of 83% compared to the rest. Using only a small portion of the dataset, we managed to attain reasonable accuracy in our models by applying the TF-IDF transformation and Latent Semantic Analysis (LSA) technique to our TDM.Keywords
This publication has 13 references indexed in Scilit:
- Grouping of Medicinal Drugs Used for Similar Symptoms by Mining Clusters from Drug Benefits ReviewsSSRN Electronic Journal, 2019
- How do we talk about doctors and drugs? Sentiment analysis in forums expressing opinions for medical domainArtificial Intelligence in Medicine, 2019
- Domain-Specific Use Cases for Knowledge-Enabled Social Media AnalysisPublished by Springer Science and Business Media LLC ,2018
- Research of Text Classification Based on Improved TF-IDF AlgorithmPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2018
- Aspect-Based Sentiment Analysis of Drug Reviews Applying Cross-Domain and Cross-Data LearningPublished by Association for Computing Machinery (ACM) ,2018
- Analysis of the effect of sentiment analysis on extracting adverse drug reactions from tweets and forum postsJournal of Biomedical Informatics, 2016
- Sentiment analysis in medical settings: New opportunities and challengesArtificial Intelligence in Medicine, 2015
- Sentiment Analysis from Medical TextsPublished by Springer Science and Business Media LLC ,2015
- A Survey of Opinion Mining and Sentiment AnalysisPublished by Springer Science and Business Media LLC ,2012
- An introduction to latent semantic analysisDiscourse Processes, 1998