Towards robust multimodal ultrasound classification for liver tumor diagnosis: A generative approach to modality missingness.

Journal: Computer methods and programs in biomedicine
PMID:

Abstract

BACKGROUND AND OBJECTIVE: In medical image analysis, combining multiple imaging modalities enhances diagnostic accuracy by providing complementary information. However, missing modalities are common in clinical settings, limiting the effectiveness of multimodal models. This study addresses the challenge of missing modalities in liver tumor diagnosis by proposing a generative model-based method for cross-modality reconstruction and classification. The dataset for this study comprises 359 case data from a hospital, with each case including three modality data: B-mode ultrasound images, Color Doppler Flow Imaging (CDFI), and clinical data. Only cases with one missing image modality are considered, excluding those with missing clinical data.

Authors

  • Jiali Guo
    College of Chemistry, Sichuan University, Chengdu610064, People's Republic of China.
  • Rui Bu
    The Second Affiliated Hospital of Kunming Medical University, Kunming, Yunnan, China.
  • Wanting Shen
    Yunnan University of Finance and Economics, Kunming, Yunnan, China.
  • Tao Feng
    School of Pharmacy, Anhui University of Chinese Medicine, Anhui Key Laboratory of Modern Chinese Materia Medica Hefei 230012 People's Republic of China tfeng@mail.scuec.edu.cn wanggk@ahtcm.edu.cn.