A multi-view co-training network for semi-supervised medical image-based prognostic prediction.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

Prognostic prediction has long been a hotspot in disease analysis and management, and the development of image-based prognostic prediction models has significant clinical implications for current personalized treatment strategies. The main challenge in prognostic prediction is to model a regression problem based on censored observations, and semi-supervised learning has the potential to play an important role in improving the utilization efficiency of censored data. However, there are yet few effective semi-supervised paradigms to be applied. In this paper, we propose a semi-supervised co-training deep neural network incorporating a support vector regression layer for survival time estimation (Co-DeepSVS) that improves the efficiency in utilizing censored data for prognostic prediction. First, we introduce a support vector regression layer in deep neural networks to deal with censored data and directly predict survival time, and more importantly to calculate the labeling confidence of each case. Then, we apply a semi-supervised multi-view co-training framework to achieve accurate prognostic prediction, where labeling confidence estimation with prior knowledge of pseudo time is conducted for each view. Experimental results demonstrate that the proposed Co-DeepSVS has a promising prognostic ability and surpasses most widely used methods on a multi-phase CT dataset. Besides, the introduction of SVR layer makes the model more robust in the presence of follow-up bias.

Authors

  • Hailin Li
    School of Bioscience and Bioengineering, South China University of Technology, Guangzhou, China.
  • Siwen Wang
    College of Science, Huazhong Agricultural University, Wuhan 430070, P.R. China.
  • Bo Liu
    Wuhan United Imaging Healthcare Surgical Technology Co., Ltd., Wuhan, China.
  • Mengjie Fang
    CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China; University of Chinese Academy of Sciences, Beijing, 100080, China.
  • Runnan Cao
    School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, PR China; CAS Key Laboratory of Molecular Imaging, Beijing Key Laboratory of Molecular Imaging, The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Hai Dian District, Beijing 100190, PR China.
  • Bingxi He
    CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Institute of Automation, Beijing, 100190, China; University of Chinese Academy of Sciences, Beijing, 100190, China.
  • Shengyuan Liu
    CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100049, China.
  • Chaoen Hu
    CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
  • Di Dong
    The Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.
  • Ximing Wang
  • Hexiang Wang
    Department of Radiology, The Affiliated Hospital of Qingdao University, Shinan Jiangsu 16 Rd, Qingdao, Shandong 266003, China.
  • Jie Tian
    CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.