Topic Model Combining Topic Word Embedding and Attention Mechanism

With the popularity of social software,mining effective information from massive digital documents has been a hotspot.The classic topic models including LDA and LSA capture topic information based on word co-occurrence and ignore the context information of words.To address the problem,this paper des...

全面介紹

書目詳細資料
發表在:Jisuanji gongcheng
主要作者: QIN Tingting, LIU Zheng, CHEN Kejia
格式: Article
語言:英语
出版: Editorial Office of Computer Engineering 2020-11-01
主題:
在線閱讀:https://www.ecice06.com/fileup/1000-3428/PDF/20201115.pdf
實物特徵
總結:With the popularity of social software,mining effective information from massive digital documents has been a hotspot.The classic topic models including LDA and LSA capture topic information based on word co-occurrence and ignore the context information of words.To address the problem,this paper designs an attention mechanism between words and topics,integrates the topic information and word information into the LDA framework,and on this basis constructs a JEA-LDA topic model.The model uses the attention mechanism between words and topics to merge the word information and topic information into feature representation for topic extraction of the LDA model.The experimental results show that compared with LDA,DMM and other models,the proposed model has better performance in topic coherence and classification tasks,and improves the topic extraction results.
ISSN:1000-3428