HGMSurvNet: A two-stage hypergraph learning network for multimodal cancer survival prediction.

Journal: Medical image analysis
Published Date:

Abstract

Cancer survival prediction based on multimodal data (e.g., pathological slides, clinical records, and genomic profiles) has become increasingly prevalent in recent years. A key challenge of this task is obtaining an effective survival-specific global representation from patient data with highly complicated correlations. Furthermore, the absence of certain modalities is a common issue in clinical practice, which renders current multimodal methods either outdated or ineffective. This article proposes a novel two-stage hypergraph learning network, called HGMSurvNet, for multimodal cancer survival prediction. HGMSurvNet can gradually learn the higher-order global representations from the WSI-level to the patient-level for multimodal learning via multilateral correlation modeling in multiple stages. Most importantly, to address the data noise and missing modalities issues in clinical scenarios, we develop a new hypergraph convolution network with a hyperedge dropout mechanism to discard unimportant hyperedges during model training. Extensive validation experiments were conducted on six public cancer cohorts from TCGA. The results demonstrated that the proposed method consistently outperforms state-of-the-art methods. We also demonstrate the interpretable analysis of HGMSurvNet and its application potential in pathological images and patient modeling, which has valuable clinical significance for the survival prognosis.

Authors

  • Saisai Ding
    School of Communication and Information Engineering, Shanghai University, Shanghai, 200444, China.; The Key Laboratory of Specialty Fiber Optics and Optical Access Networks, Shanghai University, Shanghai, 200444, China; Joint International Research Laboratory of Specialty Fiber Optics and Advanced Communication, Shanghai University, Shanghai, 200444, China; Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai, 200444, China.
  • Linjin Li
    Department of Urology, The Third Clinical Institute Affiliated to Wenzhou Medical University, The Third Affiliated Hospital of Shanghai University, Wenzhou People's Hospital, Wenzhou, 325000, China.
  • Ge Jin
    School of Information Technology, Jiangsu Open University, Nanjing, Jiangsu, China.
  • Jun Wang
    Department of Speech, Language, and Hearing Sciences and the Department of Neurology, The University of Texas at Austin, Austin, TX 78712, USA.
  • Shihui Ying
    Department of Mathematics, School of Science, Shanghai University, China. Electronic address: shying@shu.edu.cn.
  • Jun Shi
    School of Communication and Information Engineering, Shanghai University, Shanghai, China. Electronic address: junshi@staff.shu.edu.cn.