Artificial intelligence links CT images to pathologic features and survival outcomes of renal masses.

Journal: Nature communications
PMID:

Abstract

Treatment decisions for an incidental renal mass are mostly made with pathologic uncertainty. Improving the diagnosis of benign renal masses and distinguishing aggressive cancers from indolent ones is key to better treatment selection. We analyze 13261 pre-operative computed computed tomography (CT) volumes of 4557 patients. Two multi-phase convolutional neural networks are developed to predict the malignancy and aggressiveness of renal masses. The first diagnostic model designed to predict the malignancy of renal masses achieves area under the curve (AUC) of 0.871 in the prospective test set. This model surpasses the average performance of seven seasoned radiologists. The second diagnostic model differentiating aggressive from indolent tumors has AUC of 0.783 in the prospective test set. Both models outperform corresponding radiomics models and the nephrometry score nomogram. Here we show that the deep learning models can non-invasively predict the likelihood of malignant and aggressive pathology of a renal mass based on preoperative multi-phase CT images.

Authors

  • Ying Xiong
    Department of Computer Science, Harbin Institute of Technology Shenzhen Graduate School, Shenzhen, China.
  • Linpeng Yao
    Department of Radiology, the First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou 310003, China.
  • Jinglai Lin
    From the Departments of Radiology (C.D., P.Z., Z.S., M.Z., J.Z.), Urology (Y.X., J.G.), and Pathology (J.H.), Zhongshan Hospital, Fudan University, Shanghai, China; Shanghai Institute of Medical Imaging, Shanghai, China (C.D., P.Z., Z.S., M.Z.); Department of Radiology, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China (L.Y., F.C.); Departments of Urology (J.L.) and Radiology (J.Z.), Xiamen Branch, Zhongshan Hospital, Fudan University, 668 Jinhu Road, Huli District, Xiamen 361015, China; Department of Urology, Zhangye People's Hospital affiliated to Hexi University, Zhangye, China (J.Y.); Department of Radiology, the First People's Hospital of Lianyungang, Lianyungang, China (X.Z.); Department of Radiology, Quanzhou First Hospital, Fujian Medical University, Quanzhou, China (R.H.); Department of Pathology, Sir Run Run Shaw Hospital, Hangzhou, China (R.W.); Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai, China (K.W., S.W.); Shanghai Key Laboratory of MICCAI, Shanghai, China (K.W., S.W.); Xiamen Municipal Clinical Research Center for Medical Imaging, Xiamen, China (J.Z.); and Xiamen Key Clinical Specialty, Xiamen, China (J.Z.).
  • Jiaxi Yao
    From the Departments of Radiology (C.D., P.Z., Z.S., M.Z., J.Z.), Urology (Y.X., J.G.), and Pathology (J.H.), Zhongshan Hospital, Fudan University, Shanghai, China; Shanghai Institute of Medical Imaging, Shanghai, China (C.D., P.Z., Z.S., M.Z.); Department of Radiology, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China (L.Y., F.C.); Departments of Urology (J.L.) and Radiology (J.Z.), Xiamen Branch, Zhongshan Hospital, Fudan University, 668 Jinhu Road, Huli District, Xiamen 361015, China; Department of Urology, Zhangye People's Hospital affiliated to Hexi University, Zhangye, China (J.Y.); Department of Radiology, the First People's Hospital of Lianyungang, Lianyungang, China (X.Z.); Department of Radiology, Quanzhou First Hospital, Fujian Medical University, Quanzhou, China (R.H.); Department of Pathology, Sir Run Run Shaw Hospital, Hangzhou, China (R.W.); Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai, China (K.W., S.W.); Shanghai Key Laboratory of MICCAI, Shanghai, China (K.W., S.W.); Xiamen Municipal Clinical Research Center for Medical Imaging, Xiamen, China (J.Z.); and Xiamen Key Clinical Specialty, Xiamen, China (J.Z.).
  • Qi Bai
    Department of Urology, Zhongshan Hospital, Fudan University, Shanghai, China.
  • Yuan Huang
    School of Electrical Engineering and Information, Sichuan University, Chengdu 610065, China.
  • Xue Zhang
    School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an 710049, China.
  • Risheng Huang
    From the Departments of Radiology (C.D., P.Z., Z.S., M.Z., J.Z.), Urology (Y.X., J.G.), and Pathology (J.H.), Zhongshan Hospital, Fudan University, Shanghai, China; Shanghai Institute of Medical Imaging, Shanghai, China (C.D., P.Z., Z.S., M.Z.); Department of Radiology, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China (L.Y., F.C.); Departments of Urology (J.L.) and Radiology (J.Z.), Xiamen Branch, Zhongshan Hospital, Fudan University, 668 Jinhu Road, Huli District, Xiamen 361015, China; Department of Urology, Zhangye People's Hospital affiliated to Hexi University, Zhangye, China (J.Y.); Department of Radiology, the First People's Hospital of Lianyungang, Lianyungang, China (X.Z.); Department of Radiology, Quanzhou First Hospital, Fujian Medical University, Quanzhou, China (R.H.); Department of Pathology, Sir Run Run Shaw Hospital, Hangzhou, China (R.W.); Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai, China (K.W., S.W.); Shanghai Key Laboratory of MICCAI, Shanghai, China (K.W., S.W.); Xiamen Municipal Clinical Research Center for Medical Imaging, Xiamen, China (J.Z.); and Xiamen Key Clinical Specialty, Xiamen, China (J.Z.).
  • Run Wang
  • Kang Wang
    Department of Orthopedics, Third Hospital of Changsha, Changsha 410015.
  • Yu Qi
    Department of Thoracic Surgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China.
  • Pingyi Zhu
    From the Departments of Radiology (C.D., P.Z., Z.S., M.Z., J.Z.), Urology (Y.X., J.G.), and Pathology (J.H.), Zhongshan Hospital, Fudan University, Shanghai, China; Shanghai Institute of Medical Imaging, Shanghai, China (C.D., P.Z., Z.S., M.Z.); Department of Radiology, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China (L.Y., F.C.); Departments of Urology (J.L.) and Radiology (J.Z.), Xiamen Branch, Zhongshan Hospital, Fudan University, 668 Jinhu Road, Huli District, Xiamen 361015, China; Department of Urology, Zhangye People's Hospital affiliated to Hexi University, Zhangye, China (J.Y.); Department of Radiology, the First People's Hospital of Lianyungang, Lianyungang, China (X.Z.); Department of Radiology, Quanzhou First Hospital, Fujian Medical University, Quanzhou, China (R.H.); Department of Pathology, Sir Run Run Shaw Hospital, Hangzhou, China (R.W.); Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai, China (K.W., S.W.); Shanghai Key Laboratory of MICCAI, Shanghai, China (K.W., S.W.); Xiamen Municipal Clinical Research Center for Medical Imaging, Xiamen, China (J.Z.); and Xiamen Key Clinical Specialty, Xiamen, China (J.Z.).
  • Haoran Wang
    Department of Urology, The Fifth Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510700, China.
  • Li Liu
    Metanotitia Inc., Shenzhen, China.
  • Jianjun Zhou
    Beijing Key Laboratory of Energy Conversion and Storage Materials, College of Chemistry, Beijing Normal University Xinjiekouwai Street No. 19 Beijing 100875 P. R. China hhuo@bnu.edu.cn.
  • Jianming Guo
    Department of Vascular Surgery, Xuanwu Hospital, Capital Medical University, Beijing, China.
  • Feng Chen
    Department of Integrated Care Management Center, West China Hospital, Sichuan University, Chengdu, Sichuan, China.
  • Chenchen Dai
    From the Departments of Radiology (C.D., P.Z., Z.S., M.Z., J.Z.), Urology (Y.X., J.G.), and Pathology (J.H.), Zhongshan Hospital, Fudan University, Shanghai, China; Shanghai Institute of Medical Imaging, Shanghai, China (C.D., P.Z., Z.S., M.Z.); Department of Radiology, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China (L.Y., F.C.); Departments of Urology (J.L.) and Radiology (J.Z.), Xiamen Branch, Zhongshan Hospital, Fudan University, 668 Jinhu Road, Huli District, Xiamen 361015, China; Department of Urology, Zhangye People's Hospital affiliated to Hexi University, Zhangye, China (J.Y.); Department of Radiology, the First People's Hospital of Lianyungang, Lianyungang, China (X.Z.); Department of Radiology, Quanzhou First Hospital, Fujian Medical University, Quanzhou, China (R.H.); Department of Pathology, Sir Run Run Shaw Hospital, Hangzhou, China (R.W.); Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai, China (K.W., S.W.); Shanghai Key Laboratory of MICCAI, Shanghai, China (K.W., S.W.); Xiamen Municipal Clinical Research Center for Medical Imaging, Xiamen, China (J.Z.); and Xiamen Key Clinical Specialty, Xiamen, China (J.Z.).
  • Shuo Wang
    College of Tea & Food Science, Anhui Agricultural University, Hefei, China.