Harmonizing Pathological and Normal Pixels for Pseudo-Healthy Synthesis.

Journal: IEEE transactions on medical imaging
Published Date:

Abstract

Synthesizing a subject-specific pathology-free image from a pathological image is valuable for algorithm development and clinical practice. In recent years, several approaches based on the Generative Adversarial Network (GAN) have achieved promising results in pseudo-healthy synthesis. However, the discriminator (i.e., a classifier) in the GAN cannot accurately identify lesions and further hampers from generating admirable pseudo-healthy images. To address this problem, we present a new type of discriminator, the segmentor, to accurately locate the lesions and improve the visual quality of pseudo-healthy images. Then, we apply the generated images into medical image enhancement and utilize the enhanced results to cope with the low contrast problem existing in medical image segmentation. Furthermore, a reliable metric is proposed by utilizing two attributes of label noise to measure the health of synthetic images. Comprehensive experiments on the T2 modality of BraTS demonstrate that the proposed method substantially outperforms the state-of-the-art methods. The method achieves better performance than the existing methods with only 30% of the training data. The effectiveness of the proposed method is also demonstrated on the LiTS and the T1 modality of BraTS. The code and the pre-trained model of this study are publicly available at https://github.com/Au3C2/Generator-Versus-Segmentor.

Authors

  • Yunlong Zhang
    Xi'an International University, Xi'an 710077, Shaanxi, China.
  • Xin Lin
    Department of Clinical Nutrition, Daping Hospital, Army Medical University (Third Military Medical University), Chongqing, 400042, China.
  • Yihong Zhuang
  • Liyan Sun
    Fujian Key Laboratory of Sensing and Computing for Smart City, Xiamen University, Fujian, China.
  • Yue Huang
    Xiamen University, Xiamen, Fujian 361005, China.
  • Xinghao Ding
  • Guisheng Wang
    From the Department of Radiology, Wuhan Huangpi People's Hospital, Wuhan, China (L.L., Z.X., X.F., S.Z., Juan Xia); Jianghan University Affiliated Huangpi People's Hospital, Wuhan, China (L.L.); Department of Radiology, Wuhan Pulmonary Hospital, Wuhan, China (L.Q.); Keya Medical Technology Co, Ltd, Shenzhen, China (Y.Y., X.W., B.K., J.B., Y.L., Z.F., Q.S., K.C.); Department of Radiology, Liaocheng People's Hospital, Liaocheng, China (D.L.); Department of CT, The Third Medical Center of Chinese PLA General Hospital, Beijing, China (G.W.); and Department of Radiology, Shenzhen Second People's Hospital/the First Affiliated Hospital of Shenzhen University Health Science Center, Shenzhen, China 518035 (Q.X., Jun Xia).
  • Lin Yang
    National Clinical Research Center for Metabolic Diseases, Key Laboratory of Diabetes Immunology (Central South University), Ministry of Education, and Department of Metabolism and Endocrinology, The Second Xiangya Hospital of Central South University, Changsha, China.
  • Yizhou Yu
    Department of Computer Science, The University of Hong Kong, Pok Fu Lam, Hong Kong.