Fidelity imposed network edit (FINE) for solving ill-posed image reconstruction.

Journal: NeuroImage
Published Date:

Abstract

Deep learning (DL) is increasingly used to solve ill-posed inverse problems in medical imaging, such as reconstruction from noisy and/or incomplete data, as DL offers advantages over conventional methods that rely on explicit image features and hand engineered priors. However, supervised DL-based methods may achieve poor performance when the test data deviates from the training data, for example, when it has pathologies not encountered in the training data. Furthermore, DL-based image reconstructions do not always incorporate the underlying forward physical model, which may improve performance. Therefore, in this work we introduce a novel approach, called fidelity imposed network edit (FINE), which modifies the weights of a pre-trained reconstruction network for each case in the testing dataset. This is achieved by minimizing an unsupervised fidelity loss function that is based on the forward physical model. FINE is applied to two important inverse problems in neuroimaging: quantitative susceptibility mapping (QSM) and under-sampled image reconstruction in MRI. Our experiments demonstrate that FINE can improve reconstruction accuracy.

Authors

  • Jinwei Zhang
    Department of Biomedical Engineering, Cornell University, Ithaca, NY, USA; Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA.
  • Zhe Liu
    Interdisciplinary Program in Bioinformatics, Seoul National University, Seoul, Republic of Korea.
  • Shun Zhang
    Department of Radiology, Weill Cornell Medical College, New York, New York.
  • Hang Zhang
    Department of Cardiology, Rui Jin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
  • Pascal Spincemaille
    Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA.
  • Thanh D Nguyen
    Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA.
  • Mert R Sabuncu
    Department of Radiology, Weill Cornell Medicine, New York, NY, USA.
  • Yi Wang
    Department of Neurology, Children's Hospital of Fudan University, National Children's Medical Center, Shanghai, China.