MedGAN: Medical image translation using GANs.

Journal: Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society
Published Date:

Abstract

Image-to-image translation is considered a new frontier in the field of medical image analysis, with numerous potential applications. However, a large portion of recent approaches offers individualized solutions based on specialized task-specific architectures or require refinement through non-end-to-end training. In this paper, we propose a new framework, named MedGAN, for medical image-to-image translation which operates on the image level in an end-to-end manner. MedGAN builds upon recent advances in the field of generative adversarial networks (GANs) by merging the adversarial framework with a new combination of non-adversarial losses. We utilize a discriminator network as a trainable feature extractor which penalizes the discrepancy between the translated medical images and the desired modalities. Moreover, style-transfer losses are utilized to match the textures and fine-structures of the desired target images to the translated images. Additionally, we present a new generator architecture, titled CasNet, which enhances the sharpness of the translated medical outputs through progressive refinement via encoder-decoder pairs. Without any application-specific modifications, we apply MedGAN on three different tasks: PET-CT translation, correction of MR motion artefacts and PET image denoising. Perceptual analysis by radiologists and quantitative evaluations illustrate that the MedGAN outperforms other existing translation approaches.

Authors

  • Karim Armanious
    Department for Signal Processing and System Theory, University of Stuttgart, Stuttgart, Germany.
  • Chenming Jiang
    University of Stuttgart, Institute of Signal Processing and System Theory, Stuttgart, Germany.
  • Marc Fischer
    University of Stuttgart, Institute of Signal Processing and System Theory, Stuttgart, Germany; University of Tübingen, Department of Radiology, Tübingen, Germany.
  • Thomas Küstner
    Department of Radiology, Diagnostic and Interventional Radiology, Eberhard Karls University Tübingen, Germany.
  • Tobias Hepp
    University of Tübingen, Department of Radiology, Tübingen, Germany.
  • Konstantin Nikolaou
    Department of Diagnostic and Interventional Radiology, Eberhard-Karls-University, Hoppe-Seyler-Str.3, 72076 Tübingen, Germany.
  • Sergios Gatidis
    Department of Radiology, Diagnostic and Interventional Radiology, Eberhard Karls University Tübingen, Germany.
  • Bin Yang
    School of Control Science and Engineering, Dalian University of Technology, Dalian 116024, PR China. Electronic address: yangbin@dlut.edu.cn.