IPCT-Net: Parallel information bottleneck modality fusion network for obstructive sleep apnea diagnosis.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

Obstructive sleep apnea (OSA) is a common sleep breathing disorder and timely diagnosis helps to avoid the serious medical expenses caused by related complications. Existing deep learning (DL)-based methods primarily focus on single-modal models, which cannot fully mine task-related representations. This paper develops a modality fusion representation enhancement (MFRE) framework adaptable to flexible modality fusion types with the objective of improving OSA diagnostic performance, and providing quantitative evidence for clinical diagnostic modality selection. The proposed parallel information bottleneck modality fusion network (IPCT-Net) can extract local-global multi-view representations and eliminate redundant information in modality fusion representations through branch sharing mechanisms. We utilize large-scale real-world home sleep apnea test (HSAT) multimodal data to comprehensively evaluate relevant modality fusion types. Extensive experiments demonstrate that the proposed method significantly outperforms existing methods in terms of participant numbers and OSA diagnostic performance. The proposed MFRE framework delves into modality fusion in OSA diagnosis and contributes to enhancing the screening performance of artificial intelligence (AI)-assisted diagnosis for OSA.

Authors

  • Shuaicong Hu
    School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, People's Republic of China.
  • Yanan Wang
    Vasculocardiology Department, The Third People's Hospital of Datong, Datong, Shanxi, China.
  • Jian Liu
    Department of Rheumatology, The First Affiliated Hospital of Anhui University of Chinese Medicine, Hefei, Anhui, China.
  • Zhaoqiang Cui
    Department of Cardiology, Zhongshan Hospital, Fudan University, Shanghai 200032, China; Shanghai Institute of Cardiovascular Diseases, Zhongshan Hospital, Fudan University, Shanghai 200032, China.
  • Cuiwei Yang
  • Zhifeng Yao
    Department of Cardiology, Zhongshan Hospital, Fudan University, Shanghai, 200032, China.
  • Junbo Ge
    Department of Cardiology, Zhongshan Hospital, Shanghai Institute of Cardiovascular Diseases, National Clinical Research Center for Interventional Medicine, Fudan University, Shanghai, 200032, China.