A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity Matching

In the question-and-answer (Q&A) communities of the “China Agricultural Technology Extension Information Platform”, thousands of rice-related Chinese questions are newly added every day. The rapid detection of the same semantic question is the key to the success of a rice-related intelligent Q&a...

Full description

Bibliographic Details
Main Authors: Haoriqin Wang, Huaji Zhu, Huarui Wu, Xiaomin Wang, Xiao Han, Tongyu Xu
Format: Article
Language:English
Published: MDPI AG 2021-06-01
Series:Agronomy
Subjects:
Online Access:https://www.mdpi.com/2073-4395/11/7/1307
id doaj-9976d01493dd464b820d8ce2391084ac
record_format Article
spelling doaj-9976d01493dd464b820d8ce2391084ac2021-07-23T13:26:18ZengMDPI AGAgronomy2073-43952021-06-01111307130710.3390/agronomy11071307A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity MatchingHaoriqin Wang0Huaji Zhu1Huarui Wu2Xiaomin Wang3Xiao Han4Tongyu Xu5College of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang 110866, ChinaNational Engineering Research Center for Information Technology in Agriculture, Beijing 100097, ChinaNational Engineering Research Center for Information Technology in Agriculture, Beijing 100097, ChinaNational Engineering Research Center for Information Technology in Agriculture, Beijing 100097, ChinaNational Engineering Research Center for Information Technology in Agriculture, Beijing 100097, ChinaCollege of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang 110866, ChinaIn the question-and-answer (Q&A) communities of the “China Agricultural Technology Extension Information Platform”, thousands of rice-related Chinese questions are newly added every day. The rapid detection of the same semantic question is the key to the success of a rice-related intelligent Q&A system. To allow the fast and automatic detection of the same semantic rice-related questions, we propose a new method based on the Coattention-DenseGRU (Gated Recurrent Unit). According to the rice-related question characteristics, we applied word2vec with the TF-IDF (Term Frequency–Inverse Document Frequency) method to process and analyze the text data and compare it with the Word2vec, GloVe, and TF-IDF methods. Combined with the agricultural word segmentation dictionary, we applied Word2vec with the TF-IDF method, effectively solving the problem of high dimension and sparse data in the rice-related text. Each network layer employed the connection information of features and all previous recursive layers’ hidden features. To alleviate the problem of feature vector size increasing due to dense splicing, an autoencoder was used after dense concatenation. The experimental results show that rice-related question similarity matching based on Coattention-DenseGRU can improve the utilization of text features, reduce the loss of features, and achieve fast and accurate similarity matching of the rice-related question dataset. The precision and F1 values of the proposed model were 96.3% and 96.9%, respectively. Compared with seven other kinds of question similarity matching models, we present a new state-of-the-art method with our rice-related question dataset.https://www.mdpi.com/2073-4395/11/7/1307rice-related question similarity matchingnatural language processingdensely connected GRUcoattention mechanismquestion-and-answering communities
collection DOAJ
language English
format Article
sources DOAJ
author Haoriqin Wang
Huaji Zhu
Huarui Wu
Xiaomin Wang
Xiao Han
Tongyu Xu
spellingShingle Haoriqin Wang
Huaji Zhu
Huarui Wu
Xiaomin Wang
Xiao Han
Tongyu Xu
A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity Matching
Agronomy
rice-related question similarity matching
natural language processing
densely connected GRU
coattention mechanism
question-and-answering communities
author_facet Haoriqin Wang
Huaji Zhu
Huarui Wu
Xiaomin Wang
Xiao Han
Tongyu Xu
author_sort Haoriqin Wang
title A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity Matching
title_short A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity Matching
title_full A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity Matching
title_fullStr A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity Matching
title_full_unstemmed A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity Matching
title_sort densely connected gru neural network based on coattention mechanism for chinese rice-related question similarity matching
publisher MDPI AG
series Agronomy
issn 2073-4395
publishDate 2021-06-01
description In the question-and-answer (Q&A) communities of the “China Agricultural Technology Extension Information Platform”, thousands of rice-related Chinese questions are newly added every day. The rapid detection of the same semantic question is the key to the success of a rice-related intelligent Q&A system. To allow the fast and automatic detection of the same semantic rice-related questions, we propose a new method based on the Coattention-DenseGRU (Gated Recurrent Unit). According to the rice-related question characteristics, we applied word2vec with the TF-IDF (Term Frequency–Inverse Document Frequency) method to process and analyze the text data and compare it with the Word2vec, GloVe, and TF-IDF methods. Combined with the agricultural word segmentation dictionary, we applied Word2vec with the TF-IDF method, effectively solving the problem of high dimension and sparse data in the rice-related text. Each network layer employed the connection information of features and all previous recursive layers’ hidden features. To alleviate the problem of feature vector size increasing due to dense splicing, an autoencoder was used after dense concatenation. The experimental results show that rice-related question similarity matching based on Coattention-DenseGRU can improve the utilization of text features, reduce the loss of features, and achieve fast and accurate similarity matching of the rice-related question dataset. The precision and F1 values of the proposed model were 96.3% and 96.9%, respectively. Compared with seven other kinds of question similarity matching models, we present a new state-of-the-art method with our rice-related question dataset.
topic rice-related question similarity matching
natural language processing
densely connected GRU
coattention mechanism
question-and-answering communities
url https://www.mdpi.com/2073-4395/11/7/1307
work_keys_str_mv AT haoriqinwang adenselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching
AT huajizhu adenselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching
AT huaruiwu adenselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching
AT xiaominwang adenselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching
AT xiaohan adenselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching
AT tongyuxu adenselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching
AT haoriqinwang denselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching
AT huajizhu denselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching
AT huaruiwu denselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching
AT xiaominwang denselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching
AT xiaohan denselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching
AT tongyuxu denselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching
_version_ 1721289934860451840