3D Segmentation Guided Style-Based Generative Adversarial Networks for PET Synthesis.

Journal: IEEE transactions on medical imaging
Published Date:

Abstract

Potential radioactive hazards in full-dose positron emission tomography (PET) imaging remain a concern, whereas the quality of low-dose images is never desirable for clinical use. So it is of great interest to translate low-dose PET images into full-dose. Previous studies based on deep learning methods usually directly extract hierarchical features for reconstruction. We notice that the importance of each feature is different and they should be weighted dissimilarly so that tiny information can be captured by the neural network. Furthermore, the synthesis on some regions of interest is important in some applications. Here we propose a novel segmentation guided style-based generative adversarial network (SGSGAN) for PET synthesis. (1) We put forward a style-based generator employing style modulation, which specifically controls the hierarchical features in the translation process, to generate images with more realistic textures. (2) We adopt a task-driven strategy that couples a segmentation task with a generative adversarial network (GAN) framework to improve the translation performance. Extensive experiments show the superiority of our overall framework in PET synthesis, especially on those regions of interest.

Authors

  • Yang Zhou
    State Environmental Protection Key Laboratory of Environmental Pollution Health Risk Assessment, South China Institute of Environmental Sciences, Ministry of Environmental Protection, Guangzhou, China.
  • Zhiwen Yang
    ShuKun Technology Co., Ltd., Jinhui Bd, Qiyang Rd, Beijing 100029, China.
  • Hui Zhang
    Department of Pulmonary Vessel and Thrombotic Disease, Sixth Medical Center, Chinese PLA General Hospital, Beijing, China.
  • Eric I-Chao Chang
    Microsoft Research Asia, Beijing, China. eric.chang@microsoft.com.
  • Yubo Fan
    State Key Laboratory of Software Development Environment, Key Laboratory of Biomechanics and Mechanobiology of Ministry of Education, Beihang University, Beijing, China. yubofan@buaa.edu.cn.
  • Yan Xu
    Department of Nephrology, Suzhou Ninth People's Hospital, Suzhou Ninth Hospital Affiliated to Soochow University, Suzhou, China.