Learning contrast and content representations for synthesizing magnetic resonance image of arbitrary contrast.

Journal: Medical image analysis
Published Date:

Abstract

Magnetic Resonance Imaging (MRI) produces images with different contrasts, providing complementary information for clinical diagnoses and research. However, acquiring a complete set of MRI sequences can be challenging due to limitations such as lengthy scan time, motion artifacts, hardware constraints, and patient-related factors. To address this issue, we propose a novel method to learn Contrast and Content Representations (CCR) for cross-contrast MRI synthesis. Unlike existing approaches that implicitly model relationships between different contrasts, our key insight is to explicitly separate contrast information from anatomical content, allowing for more flexible and accurate synthesis. CCR learns a unified content representation that captures the underlying anatomical structures common to all contrasts, along with separate contrast representations that encode specific contrast information. By recombining the learned content representation with an arbitrary contrast representation, our method can synthesize MR images of any desired contrast. We validate our approach on both the BraTS 2021 dataset and an in-house dataset with diverse FSE acquisition parameters. Our experiments demonstrate that our CCR framework not only handles diverse input-output contrast combinations using a single trained model but also generalizes to synthesize images of new contrasts unseen during training. Quantitatively, CCR outperforms state-of-the-art methods by an average of 2.9 dB in PSNR and 0.08 in SSIM across all tested combinations. The code is available at https://github.com/xionghonglin/Arbitrary_Contrast_MRI_Synthesis.

Authors

  • Honglin Xiong
    School of Biomedical Engineering & State Key Laboratory of Advanced Medical Materials and Devices, ShanghaiTech University, Shanghai, 201210, China.
  • Yulin Wang
    Department of Automation, Tsinghua University, Beijing, China.
  • Zhenrong Shen
    School of Biological Science and Medical Engineering, Beihang University, Beijing, China; Heifei Innovation Research Institute, Beihang University, Hefei, China; Beijing Advanced Innovation Centre for Biomedical Engineering, Beihang University, Beijing, China; Beijing Advanced Innovation Centre for Big Data-Based Precision Medicine, Beihang University, Beijing, China; School of Biomedical Engineering, Anhui Medical University, Heifei, China.
  • Kaicong Sun
    Institute of Parallel and Distributed Systems, University of Stuttgart, Stuttgart, Germany.
  • Yu Fang
    Jiangsu Normal University, Xuzhou, China.
  • Yan Chen
    Department of Respiratory and Critical Care Medicine, Shanghai Pulmonary Hospital, School of Medicine, Tongji University, Shanghai, China.
  • Dinggang Shen
    School of Biomedical Engineering, ShanghaiTech University, Shanghai, China.
  • Qian Wang
    Department of Radiation Oncology, China-Japan Union Hospital of Jilin University, Changchun, China.