Unsupervised 3D End-to-End Medical Image Registration With Volume Tweening Network.

Journal: IEEE journal of biomedical and health informatics
Published Date:

Abstract

3D medical image registration is of great clinical importance. However, supervised learning methods require a large amount of accurately annotated corresponding control points (or morphing), which are very difficult to obtain. Unsupervised learning methods ease the burden of manual annotation by exploiting unlabeled data without supervision. In this article, we propose a new unsupervised learning method using convolutional neural networks under an end-to-end framework, Volume Tweening Network (VTN), for 3D medical image registration. We propose three innovative technical components: (1) An end-to-end cascading scheme that resolves large displacement; (2) An efficient integration of affine registration network; and (3) An additional invertibility loss that encourages backward consistency. Experiments demonstrate that our algorithm is 880x faster (or 3.3x faster without GPU acceleration) than traditional optimization-based methods and achieves state-of-the-art performance in medical image registration.

Authors

  • Shengyu Zhao
    Department of Drug Metabolism, Institute of Materia Medica, Chinese Academy of Medical Sciences and Peking Union Medical College, No.1 Xiannongtan Street, Beijing 100050, China; Beijing Key Laboratory of Non-Clinical Drug Metabolism and PK/PD Study, Institute of Materia Medica, Chinese Academy of Medical Sciences and Peking Union Medical College, No.1 Xiannongtan Street, Beijing 100050, China; Beijing Key Laboratory of Active Substances Discovery and Drug Ability Evaluation, Institute of Materia Medica, Chinese Academy of Medical Sciences and Peking Union Medical College, No.1 Xiannongtan Street, Beijing 100050, China; State Key Laboratory of Bioactive Substance and Function of Natural Medicines, Institute of Materia Medica, Chinese Academy of Medical Sciences and Peking Union Medical College, No.1 Xiannongtan Street, Beijing 100050, China.
  • Tingfung Lau
  • Ji Luo
  • Eric I-Chao Chang
    Microsoft Research Asia, Beijing, China. eric.chang@microsoft.com.
  • Yan Xu
    Department of Nephrology, Suzhou Ninth People's Hospital, Suzhou Ninth Hospital Affiliated to Soochow University, Suzhou, China.