An anthropomorphic diagnosis system of pulmonary nodules using weak annotation-based deep learning.

Journal: Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society
Published Date:

Abstract

The accurate categorization of lung nodules in CT scans is an essential aspect in the prompt detection and diagnosis of lung cancer. The categorization of grade and texture for nodules is particularly significant since it can aid radiologists and clinicians to make better-informed decisions concerning the management of nodules. However, currently existing nodule classification techniques have a singular function of nodule classification and rely on an extensive amount of high-quality annotation data, which does not meet the requirements of clinical practice. To address this issue, we develop an anthropomorphic diagnosis system of pulmonary nodules (PN) based on deep learning (DL) that is trained by weak annotation data and has comparable performance to full-annotation based diagnosis systems. The proposed system uses DL models to classify PNs (benign vs. malignant) with weak annotations, which eliminates the need for time-consuming and labor-intensive manual annotations of PNs. Moreover, the PN classification networks, augmented with handcrafted shape features acquired through the ball-scale transform technique, demonstrate capability to differentiate PNs with diverse labels, including pure ground-glass opacities, part-solid nodules, and solid nodules. Through 5-fold cross-validation on two datasets, the system achieved the following results: (1) an Area Under Curve (AUC) of 0.938 for PN localization and an AUC of 0.912 for PN differential diagnosis on the LIDC-IDRI dataset of 814 testing cases, (2) an AUC of 0.943 for PN localization and an AUC of 0.815 for PN differential diagnosis on the in-house dataset of 822 testing cases. In summary, our system demonstrates efficient localization and differential diagnosis of PNs in a resource limited environment, and thus could be translated into clinical use in the future.

Authors

  • Lipeng Xie
    School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu, China. Electronic address: xlpflyinsky@foxmail.com.
  • Yongrui Xu
    School of Computer Science and Technology, Hubei University of Science and Technology, Xianning, 437100, China.
  • Mingfeng Zheng
    Department of Cardio-thoracic Surgery, Nanjing Medical University Affiliated Wuxi People's Hospital, Wuxi, Jiangsu, China; Nanjing Medical University, Nanjing, Jiangsu, China.
  • Yundi Chen
    Department of Biomedical Engineering, Binghamton University, Binghamton, NY, USA.
  • Min Sun
    Division of Oncology, University of Pittsburgh Medical Center Hillman Cancer Center at St. Margaret, 200 Delafield Rd, Pittsburgh, PA, 15215, USA.
  • Michael A Archer
    Division of Thoracic Surgery, SUNY Upstate Medical University, USA.
  • Wenjun Mao
    Department of Cardio-thoracic Surgery, Nanjing Medical University Affiliated Wuxi People's Hospital, Wuxi, Jiangsu, China; Nanjing Medical University, Nanjing, Jiangsu, China. Electronic address: maowenjun1@njmu.edu.cn.
  • Yubing Tong
    Medical Image Processing Group Department of Radiology, University of Pennsylvania, Philadelphia, Pennsylvania 19104.
  • Yuan Wan
    Department of Radiology, Dongzhimen Hospital, Beijing University of Chinese Medicine, Beijing, PR China.