Transformer-Based Graph Convolutional Network for Sentiment Analysis
Open Access
- 26 January 2022
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 12 (3), 1316
- https://doi.org/10.3390/app12031316
Abstract
Sentiment Analysis is an essential research topic in the field of natural language processing (NLP) and has attracted the attention of many researchers in the last few years. Recently, deep neural network (DNN) models have been used for sentiment analysis tasks, achieving promising results. Although these models can analyze sequences of arbitrary length, utilizing them in the feature extraction layer of a DNN increases the dimensionality of the feature space. More recently, graph neural networks (GNNs) have achieved a promising performance in different NLP tasks. However, previous models cannot be transferred to a large corpus and neglect the heterogeneity of textual graphs. To overcome these difficulties, we propose a new Transformer-based graph convolutional network for heterogeneous graphs called Sentiment Transformer Graph Convolutional Network (ST-GCN). To the best of our knowledge, this is the first study to model the sentiment corpus as a heterogeneous graph and learn document and word embeddings using the proposed sentiment graph transformer neural network. In addition, our model offers an easy mechanism to fuse node positional information for graph datasets using Laplacian eigenvectors. Extensive experiments on four standard datasets show that our model outperforms the existing state-of-the-art models.Funding Information
- Fundamental Research Funds for Central Universities of the Central South University (2018gczd014 and 20190038020050;)
- Natural Science Foundation of Hunan Province (2018JJ2533;)
- National Natural Science Foundation of China (61801521, 61471368, and 61971450)
This publication has 39 references indexed in Scilit:
- Deep Learning for Extreme Multi-label Text ClassificationPublished by Association for Computing Machinery (ACM) ,2017
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- Hierarchical Attention Networks for Document ClassificationPublished by Association for Computational Linguistics (ACL) ,2016
- Modelling Public Sentiment in Twitter: Using Linguistic Patterns to Enhance Supervised LearningPublished by Springer Science and Business Media LLC ,2015
- Feature selection for sentiment analysis based on content and syntax modelsDecision Support Systems, 2012
- Sentiment Analysis and Opinion MiningSynthesis Lectures on Human Language Technologies, 2012
- Opinion Mining and Sentiment AnalysisPublished by Springer Science and Business Media LLC ,2011
- Selecting Attributes for Sentiment Classification Using Feature Relation NetworksIEEE Transactions on Knowledge and Data Engineering, 2010
- Using Noninvasive Wearable Computers to Recognize Human Emotions from Physiological SignalsEURASIP Journal on Advances in Signal Processing, 2004
- Classifying emotions in human-machine spoken dialogsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003