Deep learning based MRI reconstruction with transformer.

Journal: Computer methods and programs in biomedicine
Published Date:

Abstract

Magnetic resonance imaging (MRI) has become one of the most powerful imaging techniques in medical diagnosis, yet the prolonged scanning time becomes a bottleneck for application. Reconstruction methods based on compress sensing (CS) have made progress in reducing this cost by acquiring fewer points in the k-space. Traditional CS methods impose restrictions from different sparse domains to regularize the optimization that always requires balancing time with accuracy. Neural network techniques enable learning a better prior from sample pairs and generating the results in an analytic way. In this paper, we propose a deep learning based reconstruction method to restore high-quality MRI images from undersampled k-space data in an end-to-end style. Unlike prior literature adopting convolutional neural networks (CNN), advanced Swin Transformer is used as the backbone of our work, which proved to be powerful in extracting deep features of the image. In addition, we combined the k-space consistency in the output and further improved the quality. We compared our models with several reconstruction methods and variants, and the experiment results proved that our model achieves the best results in samples at low sampling rates. The source code of KTMR could be acquired at https://github.com/BITwzl/KTMR.

Authors

  • Zhengliang Wu
    School of Computer Science & Technology, Beijing Institute of Technology, No. 5, South Street, Zhongguancun, Beijing, 100081, China. Electronic address: wuzhengliang@bit.edu.cn.
  • Weibin Liao
    School of Computer Science & Technology, Beijing Institute of Technology, No. 5, South Street, Zhongguancun, Beijing, 100081, China.
  • Chao Yan
    School of Pharmacy, Shanghai Jiao Tong University, Shanghai 200240, China.
  • Mangsuo Zhao
    Department of Neurology, Yuquan Hospital, School of Clinical Medicine, Tsinghua University, Beijing, 100039, China.
  • Guowen Liu
    Big Data and Engineering Research Center, Beijing Children's Hospital, Capital Medical University, Department of Echocardiography, Beijing, 100045, China; Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Beihang University & Capital Medical University, Beijing, 100083, China.
  • Ning Ma
    Key Laboratory of Preparation and Applications of Environmental Friendly Materials (Jilin Normal University), Ministry of Education, Changchun 130103, PR China.
  • Xuesong Li
    Department of Chemistry, University of Wyoming, Laramie, WY, United States.