A survey on deep learning in medical image registration: New technologies, uncertainty, evaluation metrics, and beyond.

Journal: Medical image analysis
Published Date:

Abstract

Deep learning technologies have dramatically reshaped the field of medical image registration over the past decade. The initial developments, such as regression-based and U-Net-based networks, established the foundation for deep learning in image registration. Subsequent progress has been made in various aspects of deep learning-based registration, including similarity measures, deformation regularizations, network architectures, and uncertainty estimation. These advancements have not only enriched the field of image registration but have also facilitated its application in a wide range of tasks, including atlas construction, multi-atlas segmentation, motion estimation, and 2D-3D registration. In this paper, we present a comprehensive overview of the most recent advancements in deep learning-based image registration. We begin with a concise introduction to the core concepts of deep learning-based image registration. Then, we delve into innovative network architectures, loss functions specific to registration, and methods for estimating registration uncertainty. Additionally, this paper explores appropriate evaluation metrics for assessing the performance of deep learning models in registration tasks. Finally, we highlight the practical applications of these novel techniques in medical imaging and discuss the future prospects of deep learning-based image registration.

Authors

  • Junyu Chen
    Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, 21287, USA.
  • Yihao Liu
    Department of Emergency, The First Medical Center to Chinese People's Liberation Army General Hospital, Beijing, China.
  • Shuwen Wei
  • Zhangxing Bian
    Department of Electrical and Computer Engineering, Johns Hopkins University, MD, USA.
  • Shalini Subramanian
    Department of Radiology and Radiological Science, Johns Hopkins School of Medicine, MD, USA.
  • Aaron Carass
    Department of Computer Science, The Johns Hopkins University, United States; Department of Electrical and Computer Engineering, The Johns Hopkins University, United States.
  • Jerry L Prince
    Department of Electrical and Computer Engineering, The Johns Hopkins University, United States.
  • Yong Du
    Biomedical Engineering DepartmentUniversity of Houston Houston TX 77204 USA.