Knowledge graph embedding with shared latent semantic units.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

Knowledge graph embedding (KGE) aims to project both entities and relations into a continuous low-dimensional space. However, for a given knowledge graph (KG), only a small number of entities and relations occur many times, while the vast majority of entities and relations occur less frequently. This data sparsity problem has largely been ignored by most of the existing KGE models. To this end, in this paper, we propose a general technique to enable knowledge transfer among semantically similar entities or relations. Specifically, we define latent semantic units (LSUs), which are the sub-components of entity and relation embeddings. Semantically similar entities or relations are supposed to share the same LSUs, and thus knowledge can be transferred among entities or relations. Finally, extensive experiments show that the proposed technique is able to enhance existing KGE models and can provide better representations of KGs.

Authors

  • Zhao Zhang
  • Fuzhen Zhuang
    Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China. Electronic address: zhuangfz@ics.ict.ac.cn.
  • Meng Qu
    Management Science & Information Systems, Rutgers University, USA. Electronic address: mengqu@business.rutgers.edu.
  • Zheng-Yu Niu
    Baidu Inc., Beijing, China. Electronic address: niuzhengyu@baidu.com.
  • Hui Xiong
    Rutgers, The State University of New Jersey, NJ, USA.
  • Qing He