A Sentence Similarity Estimation Method Based on Improved Siamese Network
Open Access
- 1 January 2018
- journal article
- research article
- Published by Scientific Research Publishing, Inc. in Journal of Intelligent Learning Systems and Applications
- Vol. 10 (04), 121-134
- https://doi.org/10.4236/jilsa.2018.104008
Abstract
In this paper we employ an improved Siamese neural network to assess the semantic similarity between sentences. Our model implements the function of inputting two sentences to obtain the similarity score. We design our model based on the Siamese network using deep Long Short-Term Memory (LSTM) Network. And we add the special attention mechanism to let the model give different words different attention while modeling sentences. The fully-connected layer is proposed to measure the complex sentence representations. Our results show that the accuracy is better than the baseline in 2016. Furthermore, it is showed that the model has the ability to model the sequence order, distribute reasonable attention and extract meanings of a sentence in different dimensions.Keywords
This publication has 22 references indexed in Scilit:
- Hierarchical Attention Networks for Document ClassificationPublished by Association for Computational Linguistics (ACL) ,2016
- Multi-Perspective Sentence Similarity Modeling with Convolutional Neural NetworksPublished by Association for Computational Linguistics (ACL) ,2015
- Effective Approaches to Attention-based Neural Machine TranslationPublished by Association for Computational Linguistics (ACL) ,2015
- A Neural Attention Model for Abstractive Sentence SummarizationPublished by Association for Computational Linguistics (ACL) ,2015
- A Hierarchical Neural Autoencoder for Paragraphs and DocumentsPublished by Association for Computational Linguistics (ACL) ,2015
- Improved Semantic Representations From Tree-Structured Long Short-Term Memory NetworksPublished by Association for Computational Linguistics (ACL) ,2015
- Glove: Global Vectors for Word RepresentationPublished by Association for Computational Linguistics (ACL) ,2014
- SemEval-2014 Task 1: Evaluation of Compositional Distributional Semantic Models on Full Sentences through Semantic Relatedness and Textual EntailmentPublished by Association for Computational Linguistics (ACL) ,2014
- Long Short-Term MemoryNeural Computation, 1997
- SIGNATURE VERIFICATION USING A “SIAMESE” TIME DELAY NEURAL NETWORKSeries in Machine Perception and Artificial Intelligence, 1994