Graph embedding clustering: Graph attention auto-encoder with cluster-specificity distribution.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

Towards exploring the topological structure of data, numerous graph embedding clustering methods have been developed in recent years, none of them takes into account the cluster-specificity distribution of the nodes representations, resulting in suboptimal clustering performance. Moreover, most existing graph embedding clustering methods execute the nodes representations learning and clustering in two separated steps, which increases the instability of its original performance. Additionally, rare of them simultaneously takes node attributes reconstruction and graph structure reconstruction into account, resulting in degrading the capability of graph learning. In this work, we integrate the nodes representations learning and clustering into a unified framework, and propose a new deep graph attention auto-encoder for nodes clustering that attempts to learn more favorable nodes representations by leveraging self-attention mechanism and node attributes reconstruction. Meanwhile, a cluster-specificity distribution constraint, which is measured by ℓ-norm, is employed to make the nodes representations within the same cluster end up with a common distribution in the dimension space while representations with different clusters have different distributions in the intrinsic dimensions. Extensive experiment results reveal that our proposed method is superior to several state-of-the-art methods in terms of performance.

Authors

  • Huiling Xu
    State Key Laboratory of Integrated Services Networks, Xidian University, Shaanxi 710071, China.
  • Wei Xia
    Key Laboratory of Environment and Health, Ministry of Education & Ministry of Environmental Protection, State Key Laboratory of Environmental Health (Incubation), School of Public Health, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China.
  • Quanxue Gao
    State Key Laboratory, Integrated Services Networks, Xidian University, 710071, Xi'an, China. Electronic address: qxgao@xidian.edu.cn.
  • Jungong Han
    School of Computing and Communications, Lancaster University, United Kingdom.
  • Xinbo Gao