SynMSE: A multimodal similarity evaluator for complex distribution discrepancy in unsupervised deformable multimodal medical image registration.

Journal: Medical image analysis
Published Date:

Abstract

Unsupervised deformable multimodal medical image registration often confronts complex scenarios, which include intermodality domain gaps, multi-organ anatomical heterogeneity, and physiological motion variability. These factors introduce substantial grayscale distribution discrepancies, hindering precise alignment between different imaging modalities. However, existing methods have not been sufficiently adapted to meet the specific demands of registration in such complex scenarios. To overcome the above challenges, we propose SynMSE, a novel multimodal similarity evaluator that can be seamlessly integrated as a plug-and-play module in any registration framework to serve as the similarity metric. SynMSE is trained using random transformations to simulate spatial misalignments and a structure-constrained generator to model grayscale distribution discrepancies. By emphasizing spatial alignment and mitigating the influence of complex distributional variations, SynMSE effectively addresses the aforementioned issues. Extensive experiments on the Learn2Reg 2022 CT-MR abdomen dataset, the clinical cervical CT-MR dataset, and the CuRIOUS MR-US brain dataset demonstrate that SynMSE achieves state-of-the-art performance. Our code is available on the project page https://github.com/MIXAILAB/SynMSE.

Authors

  • Jingke Zhu
    Key Laboratory of Biomass Chemical Engineering of Ministry of Education, College of Chemical and Biological Engineering, Zhejiang University, Hangzhou 310027, China.
  • Boyun Zheng
    Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, Shenzhen 518055, China.
  • Bing Xiong
    Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China; University of Chinese Academy of Sciences, Beijing 101400, China.
  • Yuxin Zhang
    State Key Laboratory of Oral Diseases, National Clinical Research Center for Oral Diseases, West China Hospital of Stomatology , Sichuan University , Chengdu 610041 , People's Republic of China.
  • Ming Cui
    Department of Radiation Oncology Gastrointestinal and Urinary and Musculoskeletal Cancer, 74665Cancer Hospital of China Medical University, Shenyang, Liaoning, China.
  • Deyu Sun
    Department of Radiation Oncology Gastrointestinal and Urinary and Musculoskeletal Cancer, 74665Cancer Hospital of China Medical University, Shenyang, Liaoning, China.
  • Jing Cai
    Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China.
  • Yaoqin Xie
    Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China.
  • Wenjian Qin
    Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China.