Multi-energy level fusion for nodal metastasis classification of primary lung tumor on dual energy CT using deep learning.

Journal: Computers in biology and medicine
Published Date:

Abstract

Lymph node metastasis also called nodal metastasis (Nmet), is a clinically primary task for physicians. The survival and recurrence of lung cancer are related to the Nmet staging from Tumor-Node-Metastasis (TNM) reports. Furthermore, preoperative Nmet prediction is still a challenge for the patient in managing the surgical plan and making treatment decisions. We proposed a multi-energy level fusion model with a principal feature enhancement (PFE) block incorporating radiologist and computer science knowledge for Nmet prediction. The proposed model is custom-designed by gemstone spectral imaging (GSI) with different energy levels on dual-energy computer tomography (CT) from a primary tumor of lung cancer. In the experiment, we take three different energy level fusion datasets: lower energy level fusion (40, 50, 60, 70 keV), higher energy level fusion (110, 120, 130, 140 keV), and average energy level fusion (40, 70, 100, 140 keV). The proposed model is trained by lower energy level fusion that is 93% accurate and the value of Kappa is 86%. When we used the lower energy level images to train the fusion model, there has been a significant difference to other energy level fusion models. Hence, we apply 5-fold cross-validation, which is used to validate the performance result of the multi-keV model with different fusion datasets of energy level images in the pathology report. The cross-validation result also demonstrates that the model with the lower energy level dataset is more robust and suitable in predicting the Nmet of the primary tumor. The lower energy level shows more information of tumor angiogenesis or heterogeneity provided the proposed fusion model with a PFE block and channel attention blocks to predict Nmet from primary tumors.

Authors

  • You-Wei Wang
    Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan.
  • Chii-Jen Chen
    Department of Medical Imaging and Radiological Technology, Yuanpei University of Medical Technology, Hsinchu, Taiwan. Electronic address: cjchen@mail.ypu.edu.tw.
  • Teh-Chen Wang
    Department of Medical Imaging, Taipei City Hospital, Yangming Branch, Taipei, Taiwan.
  • Hsu-Cheng Huang
    Department of Medical Imaging, National Taiwan University Hospital and National Taiwan University College of Medicine, Taipei, Taiwan; Department of Radiology, Taipei City Hospital, Yangming Branch, Taipei, Taiwan.
  • Hsin-Ming Chen
    Department of Medical Imaging, National Taiwan University Hospital and National Taiwan University College of Medicine, Taipei, Taiwan.
  • Jin-Yuan Shih
    Department of Internal Medicine, National Taiwan University Hospital and National Taiwan University College of Medicine, Taipei, Taiwan.
  • Jin-Shing Chen
    Department of Surgery, National Taiwan University Hospital and National Taiwan University College of Medicine, Taipei, Taiwan.
  • Yu-Sen Huang
    Department of Medical Imaging, National Taiwan University Hospital and National Taiwan University College of Medicine, Taipei, Taiwan.
  • Yeun-Chung Chang
    Department of Medical Imaging, National Taiwan University Hospital and National Taiwan University College of Medicine, Taipei, Taiwan.
  • Ruey-Feng Chang
    Graduate Institute of Biomedical Electronics and Bioinformatics, National Taiwan University, Taipei 10617, Taiwan and Department of Computer Science and Information Engineering, National Taiwan University, Taipei 10617, Taiwan.