3D CNN-based Deep Learning Model-based Explanatory Prognostication in Patients  with Multiple Myeloma using Whole-body MRI.

Journal: Journal of medical systems
Published Date:

Abstract

Although magnetic resonance imaging (MRI) data of patients with multiple myeloma (MM) are used to predict prognosis, few reports have applied artificial intelligence (AI) techniques for this purpose. We aimed to analyze whole-body diffusion-weighted MRI data using three-dimensional (3D) convolutional neural networks (CNNs) and Gradient-weighted Class Activation Mapping (Grad-CAM), an explainable AI, to predict prognosis and explore the factors involved in prediction. We retrospectively analyzed the MRI data of a total of 142 patients with MM obtained from two medical centers. We defined the occurrence of progressive disease after MRI evaluation within 12 months as a poor prognosis and constructed a 3D CNN-based deep learning model to predict prognosis. Images from 111 cases were used as the training and internal validation data; images from 31 cases were used as the external validation data. Internal validation of the AI model with stratified 5-fold cross-validation resulted in a significant difference in progression-free survival (PFS) between good and poor prognostic cases (2-year PFS, 91.2% versus [vs.] 61.1%, P = 0.0002). The AI model clearly stratified good and poor prognostic cases in the external validation cohort (2-year PFS, 92.9% vs. 55.6%, P = 0.004), with an area under the receiver operating characteristic curve of 0.804. According to Grad-CAM, the MRI signals of the spleen and bones of the vertebrae and pelvis contributed to prognosis prediction. This study is the first to show that image analysis of whole-body MRI using a 3D CNN without any other clinical data is effective in predicting the prognosis of patients with MM.

Authors

  • Kento Morita
    School of Electrical Information Communication Engineering, College of Science and Engineering, Kanazawa University Kanazawa Japan.
  • Shigehiro Karashima
    Institute of Liberal Arts and Science, Kanazawa University Kanazawa Japan.
  • Toshiki Terao
    Department of Hematology/Oncology, Kameda Medical Center, Kamogawa, Japan.
  • Kotaro Yoshida
    1 Department of Radiology, Radiology Informatics Laboratory, Mayo Clinic, 3507 17th Ave NW, Rochester, MN 55901.
  • Takeshi Yamashita
    The Cardiovascular Institute Tokyo Japan.
  • Takeshi Yoroidaka
    Department of Hematology, Ishikawa Central Prefectural Hospital, Kanazawa, Japan.
  • Mikoto Tanabe
    Department of Hematology, Ishikawa Central Prefectural Hospital, Kanazawa, Japan.
  • Tatsuya Imi
    Department of Hematology, Faculty of Medicine, Institute of Medical, Pharmaceutical, and Health Sciences, Kanazawa University, Kanazawa, Japan.
  • Yoshitaka Zaimoku
    Department of Hematology, Faculty of Medicine, Institute of Medical, Pharmaceutical, and Health Sciences, Kanazawa University, Kanazawa, Japan.
  • Akiyo Yoshida
    Department of Hematology, Faculty of Medicine, Institute of Medical, Pharmaceutical, and Health Sciences, Kanazawa University, Kanazawa, Japan.
  • Hiroyuki Maruyama
    Department of Hematology, Faculty of Medicine, Institute of Medical, Pharmaceutical, and Health Sciences, Kanazawa University, Kanazawa, Japan.
  • Noriko Iwaki
    Department of Hematology, Faculty of Medicine, Institute of Medical, Pharmaceutical, and Health Sciences, Kanazawa University, Kanazawa, Japan.
  • Go Aoki
    Department of Hematology, Faculty of Medicine, Institute of Medical, Pharmaceutical, and Health Sciences, Kanazawa University, Kanazawa, Japan.
  • Takeharu Kotani
    Department of Hematology, Ishikawa Central Prefectural Hospital, Kanazawa, Japan.
  • Ryoichi Murata
    Division of Internal Medicine, Keiju Kanazawa Hospital, Kanazawa, Japan.
  • Toshihiro Miyamoto
    Department of Hematology, Faculty of Medicine, Institute of Medical, Pharmaceutical, and Health Sciences, Kanazawa University, Kanazawa, Japan.
  • Youichi Machida
    Department of Radiology, Kameda Medical Center, Kamogawa, Japan.
  • Kosei Matsue
    Department of Hematology/Oncology, Kameda Medical Center, Kamogawa, Japan.
  • Hidetaka Nambo
    School of Electrical Information Communication Engineering, College of Science and Engineering, Kanazawa University Kanazawa Japan.
  • Hiroyuki Takamatsu
    Department of Hematology, Faculty of Medicine, Institute of Medical, Pharmaceutical, and Health Sciences, Kanazawa University, Kanazawa, Japan. takamaz@staff.kanazawa-u.ac.jp.