Text Recommendation Based on Heterogeneous Attention Recurrent Neural Network

To improve the inaccurate text recommendation in the big data environment,this paper merges two kinds of heterogeneous data,text data and relational network,and introduces the encoder-decoder framework.On this basis,a Recurrent Neural Network(RNN) model based on heterogeneous attention is proposed f...

詳細記述

書誌詳細
出版年:Jisuanji gongcheng
第一著者: NIU Yaoqiang, MENG Yuyu, NIU Quanfu
フォーマット: 論文
言語:英語
出版事項: Editorial Office of Computer Engineering 2020-10-01
主題:
オンライン・アクセス:https://www.ecice06.com/fileup/1000-3428/PDF/20201006.pdf
_version_ 1848649759551651840
author NIU Yaoqiang, MENG Yuyu, NIU Quanfu
author_facet NIU Yaoqiang, MENG Yuyu, NIU Quanfu
author_sort NIU Yaoqiang, MENG Yuyu, NIU Quanfu
collection DOAJ
container_title Jisuanji gongcheng
description To improve the inaccurate text recommendation in the big data environment,this paper merges two kinds of heterogeneous data,text data and relational network,and introduces the encoder-decoder framework.On this basis,a Recurrent Neural Network(RNN) model based on heterogeneous attention is proposed for short-term text recommendation.The sentence-level Distributed Memory Model of Paragraph Vectors(PV-DM) and the representation method for entity relations,TransR,are used to embed text data and relational network into high-dimensional vectors as the input of the model.In the encoding stage,the short-term interests of users are introduced into the recommendation model by using bidirectional GRU,and the attention mechanism is used to connect with the decoder,so that the decoder can dynamically select and linearly combine different parts of the input sequence of the encoder in order to build short-term interests of users.In the decoder stage,the attention output of the encoder,the candidate items,and the representation of current users are taken as inputs.The score of each candidate item is calculated with the bidirectional GRU and the feedforward network layer to obtain the recommendation result.Experimental results show that compared with TF-IDF,ItemKNN and other models,the proposed model significantly improves the recall rate and the average precision of the mean.
format Article
id doaj-b2fa5f33ff29430dadde8bf637c5c303
institution Directory of Open Access Journals
issn 1000-3428
language English
publishDate 2020-10-01
publisher Editorial Office of Computer Engineering
record_format Article
spelling doaj-b2fa5f33ff29430dadde8bf637c5c3032025-11-03T05:53:25ZengEditorial Office of Computer EngineeringJisuanji gongcheng1000-34282020-10-014610525910.19678/j.issn.1000-3428.0055861Text Recommendation Based on Heterogeneous Attention Recurrent Neural NetworkNIU Yaoqiang, MENG Yuyu, NIU Quanfu01. School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China;2. College of Civil Engineering, Lanzhou University of Technology, Lanzhou 730050, ChinaTo improve the inaccurate text recommendation in the big data environment,this paper merges two kinds of heterogeneous data,text data and relational network,and introduces the encoder-decoder framework.On this basis,a Recurrent Neural Network(RNN) model based on heterogeneous attention is proposed for short-term text recommendation.The sentence-level Distributed Memory Model of Paragraph Vectors(PV-DM) and the representation method for entity relations,TransR,are used to embed text data and relational network into high-dimensional vectors as the input of the model.In the encoding stage,the short-term interests of users are introduced into the recommendation model by using bidirectional GRU,and the attention mechanism is used to connect with the decoder,so that the decoder can dynamically select and linearly combine different parts of the input sequence of the encoder in order to build short-term interests of users.In the decoder stage,the attention output of the encoder,the candidate items,and the representation of current users are taken as inputs.The score of each candidate item is calculated with the bidirectional GRU and the feedforward network layer to obtain the recommendation result.Experimental results show that compared with TF-IDF,ItemKNN and other models,the proposed model significantly improves the recall rate and the average precision of the mean.https://www.ecice06.com/fileup/1000-3428/PDF/20201006.pdfshort-term text recommendation|data embedding|heterogeneous data|bidirectional gru|attention mechanism
spellingShingle NIU Yaoqiang, MENG Yuyu, NIU Quanfu
Text Recommendation Based on Heterogeneous Attention Recurrent Neural Network
short-term text recommendation|data embedding|heterogeneous data|bidirectional gru|attention mechanism
title Text Recommendation Based on Heterogeneous Attention Recurrent Neural Network
title_full Text Recommendation Based on Heterogeneous Attention Recurrent Neural Network
title_fullStr Text Recommendation Based on Heterogeneous Attention Recurrent Neural Network
title_full_unstemmed Text Recommendation Based on Heterogeneous Attention Recurrent Neural Network
title_short Text Recommendation Based on Heterogeneous Attention Recurrent Neural Network
title_sort text recommendation based on heterogeneous attention recurrent neural network
topic short-term text recommendation|data embedding|heterogeneous data|bidirectional gru|attention mechanism
url https://www.ecice06.com/fileup/1000-3428/PDF/20201006.pdf
work_keys_str_mv AT niuyaoqiangmengyuyuniuquanfu textrecommendationbasedonheterogeneousattentionrecurrentneuralnetwork