Cross-sequence semi-supervised learning for multi-parametric MRI-based visual pathway delineation.

Journal: Physics in medicine and biology
Published Date:

Abstract

Objective.Accurately delineating the visual pathway (VP) is crucial for understanding the human visual system and diagnosing related disorders. Exploring multi-parametric MR imaging data has been identified as an important way to delineate VP. However, due to the complex cross-sequence relationships, existing methods cannot effectively model the complementary information from different MRI sequences. In addition, these existing methods heavily rely on large training data with labels, which is labor-intensive and time-consuming to obtain.Approach.We propose a novel semi-supervised multi-parametric feature decomposition framework for VP delineation. Specifically, a correlation-constrained feature decomposition is designed to handle the complex cross-sequence relationships by capturing the unique characteristics of each MRI sequence and easing the multi-parametric information fusion process. Furthermore, a consistency-based sample enhancement module is developed to address the limited labeled data issue, by generating and promoting meaningful edge information from unlabeled data.Main results.We validate our framework using two public datasets and one in-house multi-shell diffusion MRI dataset. Experimental results demonstrate the superiority of our approach in terms of delineation performance when compared to six state-of-the-art approaches.Significance.Our proposed framework effectively mitigates the challenges of modeling complex cross-sequence relationships and limited labeled data, offering a robust solution for accurate VP delineation. This approach not only enhances the understanding of the human visual system but also holds potential for improving the diagnosis of VP-related disorders.

Authors

  • Alou Diakite
    Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China.
  • Cheng Li
    College of Food and Bioengineering, Henan University of Science and Technology, Luoyang, China.
  • Lei Xie
    Ph.D. Program in Computer Science, The City University of New York, New York, NY, United States.
  • Ruoyou Wu
    Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China.
  • Yuanjing Feng
    Institute of Information Processing and Automation, College of Information Engineering, Zhejiang University of Technology, Hangzhou 310023, China; Zhejiang Provincial United Key Laboratory of Embedded Systems, Hangzhou 310023, China. Electronic address: [email protected].
  • Jianzhong He
    College of Information Engineering, Zhejiang University of Technology, Hangzhou, China.
  • Shanshan Wang
    Key Laboratory of Agri-food Safety and Quality, Institute of Quality Standard and Testing Technology for Agro-Products, Chinese Academy of Agricultural Sciences, Ministry of Agriculture of China, Beijing, 100081, PR China.