Knowledge Graph Construction and Applications for Web Search and Beyond

• Main Authors: Wang, Peilu, Jiang, Hao, Xu, Jingfang, Zhang, Qi
• Format: Article
• Language: English
• Published: The MIT Press 2019-11-01
• Series: Data Intelligence
• Online Access: https://www.mitpressjournals.org/doi/abs/10.1162/dint_a_00019

Knowledge graph (KG) has played an important role in enhancing the performance of many intelligent systems. In this paper, we introduce the solution of building a large-scale multi-source knowledge graph from scratch in Sogou Inc., including its architecture, technical implementation and applications. Unlike previous works that build knowledge graph with graph databases, we build the knowledge graph on top of SogouQdb, a distributed search engine developed by Sogou Web Search Department, which can be easily scaled to support petabytes of data. As a supplement to the search engine, we also introduce a series of models to support inference and graph based querying. Currently, the data of Sogou knowledge graph that are collected from 136 different websites and constantly updated consist of 54 million entities and over 600 million entity links. We also introduce three applications of knowledge graph in Sogou Inc.: entity detection and linking, knowledge based question answering and knowledge based dialog system. These applications have been used in Web search products to help user acquire information more efficiently.