Self-Supervised Hypergraph Training Framework via Structure-Aware Learning.

Journal: IEEE transactions on pattern analysis and machine intelligence
Published Date:

Abstract

Hypergraphs, with their ability to model complex, beyond pair-wise correlations, presents a significant advancement over traditional graphs for capturing intricate relational data across diverse domains. However, the integration of hypergraphs into self-supervised learning (SSL) frameworks has been hindered by the intricate nature of high-order structural variations. This paper introduces the Self-Supervised Hypergraph Training Framework via Structure-Aware Learning (SS-HT), designed to enhance the perception and measurement of these variations within hypergraphs. The SS-HT framework employs a "Masking and Re-Masking" strategy to bolster feature reconstruction in Hypergraph Neural Networks (HGNNs), addressing the limitations of traditional SSL methods. It also introduces a metric strategy for local high-order correlation changes, streamlining the computational efficiency of structural distance calculations. Extensive experiments on 11 datasets demonstrate SS-HT's superior performance over existing SSL methods for both low-order and high-order data. Notably, the framework significantly reduces data labeling dependency, achieving a 32% improvement over HGNN in the downstream task fine-tuning phase under the 1% labeled data setting in the Cora-CC dataset. Ablation studies further validate SS-HT's scalability and its capacity to augment the performance of various HGNN methods, underscoring its robustness and applicability in real-world scenarios.

Authors

  • Yifan Feng
    College of Engineering, Shantou University, ShanTou, Guangdong, China.
  • Shiquan Liu
    Institute of Forensic Science, Fudan University, Shanghai, China. shiquanliu@fudan.edu.cn.
  • Shihui Ying
    Department of Mathematics, School of Science, Shanghai University, China. Electronic address: shying@shu.edu.cn.
  • Shaoyi Du
    Institute of Artificial Intelligence and Robotics, Xian Jiaotong University, Xian Shanxi Province, China.
  • Zongze Wu
    School of Automation, Guangdong University of Technology, Guangzhou, Guangdong, 510006, China. Electronic address: zzwu@gdut.edu.cn.
  • Yue Gao
    Institute of Medical Technology, Peking University Health Science Center, Beijing, China.

Keywords

No keywords available for this article.