Diagnostic evaluation of a deep learning model for optical diagnosis of colorectal cancer.

Journal: Nature communications
Published Date:

Abstract

Colonoscopy is commonly used to screen for colorectal cancer (CRC). We develop a deep learning model called CRCNet for optical diagnosis of CRC by training on 464,105 images from 12,179 patients and test its performance on 2263 patients from three independent datasets. At the patient-level, CRCNet achieves an area under the precision-recall curve (AUPRC) of 0.882 (95% CI: 0.828-0.931), 0.874 (0.820-0.926) and 0.867 (0.795-0.923). CRCNet exceeds average endoscopists performance on recall rate across two test sets (91.3% versus 83.8%; two-sided t-test, p < 0.001 and 96.5% versus 90.3%; p = 0.006) and precision for one test set (93.7% versus 83.8%; p = 0.02), while obtains comparable recall rate on one test set and precision on the other two. At the image-level, CRCNet achieves an AUPRC of 0.990 (0.987-0.993), 0.991 (0.987-0.995), and 0.997 (0.995-0.999). Our study warrants further investigation of CRCNet by prospective clinical trials.

Authors

  • Dejun Zhou
    Department of Endoscopic Diagnosis and Therapy, National Clinical Research Center for Cancer, Key Laboratory of Molecular Cancer Epidemiology of Tianjin, Tianjin's Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin Medical University Cancer Institute and Hospital, Tianjin Medical University, Tianjin, China.
  • Fei Tian
    Department of Colorectal Cancer, National Clinical Research Center for Cancer, Key Laboratory of Molecular Cancer Epidemiology of Tianjin, Tianjin's Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin Medical University Cancer Institute and Hospital, Tianjin Medical University, Tianjin, China.
  • Xiangdong Tian
    Department of Endoscopic Diagnosis and Therapy, National Clinical Research Center for Cancer, Key Laboratory of Molecular Cancer Epidemiology of Tianjin, Tianjin's Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin Medical University Cancer Institute and Hospital, Tianjin Medical University, Tianjin, China.
  • Lin Sun
    College of Computer and Information Engineering, Henan Normal University, Xinxiang, China.
  • Xianghui Huang
    General Surgery Department, Ningbo First Hospital, Zhejiang University Ningbo Hospital, Ningbo, China.
  • Feng Zhao
    Department of Blood Transfusion, The First Affiliated Hospital of Ningbo University, Ningbo, China.
  • Nan Zhou
    Department of Radiology, the Affiliated Nanjing Drum Tower Hospital of Nanjing University Medical School, Nanjing 210008, China.
  • Zuoyu Chen
    General Surgery Department, General Hospital of Tianjin Medical University, Tianjin Medical University, Tianjin, China.
  • Qiang Zhang
    Yunan Provincial Center for Disease Control and Prevention, Kunming 650022, China.
  • Meng Yang
  • Yichen Yang
    The First Clinical Medical College, Lanzhou University, Lanzhou, China.
  • Xuexi Guo
    Department of Pathology, Tianjin First Central Hospital, Tianjin, China.
  • Zhibin Li
    Epidemiology Research Unit, The First Affiliated Hospital of Xiamen University, Xiamen, China, zhibinli33@163.com.
  • Jia Liu
    Department of Colorectal Oncology, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Tianjin's Clinical Research Center for Cancer, Tianjin Key Laboratory of Digestive Cancer, Tianjin, China.
  • Jiefu Wang
    Department of Colorectal Oncology, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Tianjin's Clinical Research Center for Cancer, Tianjin Key Laboratory of Digestive Cancer, Tianjin, China.
  • Junfeng Wang
    Department of Colorectal Oncology, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Tianjin's Clinical Research Center for Cancer, Tianjin Key Laboratory of Digestive Cancer, Tianjin, China.
  • Bangmao Wang
    Department of Gastroenterology, General Hospital of Tianjin Medical University, Tianjin Medical University, Tianjin, China.
  • Guoliang Zhang
    Department of Digestion and Endoscopy, Tianjin First Central Hospital, Tianjin, China.
  • Baocun Sun
    Department of Pathology, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin; Tianjin's Clinical Research Center for Cancer, Tianjin Medical University, Ministry of Education, Tianjin 300060, China.
  • Wei Zhang
    The First Affiliated Hospital of Nanchang University, Nanchang, China.
  • Dalu Kong
    Department of Colorectal Oncology, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Tianjin's Clinical Research Center for Cancer, Tianjin Key Laboratory of Digestive Cancer, Tianjin, China.
  • Kexin Chen
    Zhongshan School of Medicine, Sun Yat-sen University, Guangzhou, China.
  • Xiangchun Li
    Tianjin Cancer Institute, National Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy of Tianjin, Tianjin Medical University Cancer Institute and Hospital, Tianjin Medical University, Tianjin, China.