Text Recommendation Based on Heterogeneous Attention Recurrent Neural Network
To improve the inaccurate text recommendation in the big data environment,this paper merges two kinds of heterogeneous data,text data and relational network,and introduces the encoder-decoder framework.On this basis,a Recurrent Neural Network(RNN) model based on heterogeneous attention is proposed f...
| 出版年: | Jisuanji gongcheng |
|---|---|
| 第一著者: | |
| フォーマット: | 論文 |
| 言語: | 英語 |
| 出版事項: |
Editorial Office of Computer Engineering
2020-10-01
|
| 主題: | |
| オンライン・アクセス: | https://www.ecice06.com/fileup/1000-3428/PDF/20201006.pdf |
| _version_ | 1848649759551651840 |
|---|---|
| author | NIU Yaoqiang, MENG Yuyu, NIU Quanfu |
| author_facet | NIU Yaoqiang, MENG Yuyu, NIU Quanfu |
| author_sort | NIU Yaoqiang, MENG Yuyu, NIU Quanfu |
| collection | DOAJ |
| container_title | Jisuanji gongcheng |
| description | To improve the inaccurate text recommendation in the big data environment,this paper merges two kinds of heterogeneous data,text data and relational network,and introduces the encoder-decoder framework.On this basis,a Recurrent Neural Network(RNN) model based on heterogeneous attention is proposed for short-term text recommendation.The sentence-level Distributed Memory Model of Paragraph Vectors(PV-DM) and the representation method for entity relations,TransR,are used to embed text data and relational network into high-dimensional vectors as the input of the model.In the encoding stage,the short-term interests of users are introduced into the recommendation model by using bidirectional GRU,and the attention mechanism is used to connect with the decoder,so that the decoder can dynamically select and linearly combine different parts of the input sequence of the encoder in order to build short-term interests of users.In the decoder stage,the attention output of the encoder,the candidate items,and the representation of current users are taken as inputs.The score of each candidate item is calculated with the bidirectional GRU and the feedforward network layer to obtain the recommendation result.Experimental results show that compared with TF-IDF,ItemKNN and other models,the proposed model significantly improves the recall rate and the average precision of the mean. |
| format | Article |
| id | doaj-b2fa5f33ff29430dadde8bf637c5c303 |
| institution | Directory of Open Access Journals |
| issn | 1000-3428 |
| language | English |
| publishDate | 2020-10-01 |
| publisher | Editorial Office of Computer Engineering |
| record_format | Article |
| spelling | doaj-b2fa5f33ff29430dadde8bf637c5c3032025-11-03T05:53:25ZengEditorial Office of Computer EngineeringJisuanji gongcheng1000-34282020-10-014610525910.19678/j.issn.1000-3428.0055861Text Recommendation Based on Heterogeneous Attention Recurrent Neural NetworkNIU Yaoqiang, MENG Yuyu, NIU Quanfu01. School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China;2. College of Civil Engineering, Lanzhou University of Technology, Lanzhou 730050, ChinaTo improve the inaccurate text recommendation in the big data environment,this paper merges two kinds of heterogeneous data,text data and relational network,and introduces the encoder-decoder framework.On this basis,a Recurrent Neural Network(RNN) model based on heterogeneous attention is proposed for short-term text recommendation.The sentence-level Distributed Memory Model of Paragraph Vectors(PV-DM) and the representation method for entity relations,TransR,are used to embed text data and relational network into high-dimensional vectors as the input of the model.In the encoding stage,the short-term interests of users are introduced into the recommendation model by using bidirectional GRU,and the attention mechanism is used to connect with the decoder,so that the decoder can dynamically select and linearly combine different parts of the input sequence of the encoder in order to build short-term interests of users.In the decoder stage,the attention output of the encoder,the candidate items,and the representation of current users are taken as inputs.The score of each candidate item is calculated with the bidirectional GRU and the feedforward network layer to obtain the recommendation result.Experimental results show that compared with TF-IDF,ItemKNN and other models,the proposed model significantly improves the recall rate and the average precision of the mean.https://www.ecice06.com/fileup/1000-3428/PDF/20201006.pdfshort-term text recommendation|data embedding|heterogeneous data|bidirectional gru|attention mechanism |
| spellingShingle | NIU Yaoqiang, MENG Yuyu, NIU Quanfu Text Recommendation Based on Heterogeneous Attention Recurrent Neural Network short-term text recommendation|data embedding|heterogeneous data|bidirectional gru|attention mechanism |
| title | Text Recommendation Based on Heterogeneous Attention Recurrent Neural Network |
| title_full | Text Recommendation Based on Heterogeneous Attention Recurrent Neural Network |
| title_fullStr | Text Recommendation Based on Heterogeneous Attention Recurrent Neural Network |
| title_full_unstemmed | Text Recommendation Based on Heterogeneous Attention Recurrent Neural Network |
| title_short | Text Recommendation Based on Heterogeneous Attention Recurrent Neural Network |
| title_sort | text recommendation based on heterogeneous attention recurrent neural network |
| topic | short-term text recommendation|data embedding|heterogeneous data|bidirectional gru|attention mechanism |
| url | https://www.ecice06.com/fileup/1000-3428/PDF/20201006.pdf |
| work_keys_str_mv | AT niuyaoqiangmengyuyuniuquanfu textrecommendationbasedonheterogeneousattentionrecurrentneuralnetwork |
