Synthesis of diagnostic quality cancer pathology images by generative adversarial networks.

Journal: The Journal of pathology
Published Date:

Abstract

Deep learning-based computer vision methods have recently made remarkable breakthroughs in the analysis and classification of cancer pathology images. However, there has been relatively little investigation of the utility of deep neural networks to synthesize medical images. In this study, we evaluated the efficacy of generative adversarial networks to synthesize high-resolution pathology images of 10 histological types of cancer, including five cancer types from The Cancer Genome Atlas and the five major histological subtypes of ovarian carcinoma. The quality of these images was assessed using a comprehensive survey of board-certified pathologists (n = 9) and pathology trainees (n = 6). Our results show that the real and synthetic images are classified by histotype with comparable accuracies and the synthetic images are visually indistinguishable from real images. Furthermore, we trained deep convolutional neural networks to diagnose the different cancer types and determined that the synthetic images perform as well as additional real images when used to supplement a small training set. These findings have important applications in proficiency testing of medical practitioners and quality assurance in clinical laboratories. Furthermore, training of computer-aided diagnostic systems can benefit from synthetic images where labeled datasets are limited (e.g. rare cancers). We have created a publicly available website where clinicians and researchers can attempt questions from the image survey (http://gan.aimlab.ca/). © 2020 Pathological Society of Great Britain and Ireland. Published by John Wiley & Sons, Ltd.

Authors

  • Adrian B Levine
    Pathology and Laboratory Medicine, University of British Columbia, Vancouver, BC, Canada.
  • Jason Peng
    Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, Canada.
  • David Farnell
    Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, Canada.
  • Mitchell Nursey
    Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, Canada.
  • Yiping Wang
    Shenzhen Key Laboratory of Photonic Devices and Sensing Systems for Internet of Things, Guangdong and Hong Kong Joint Research Centre for Optical Fibre Sensors, State Key Laboratory of Radio Frequency Heterogeneous Integration, Shenzhen University, Shenzhen 518060, China.
  • Julia R Naso
    Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, Canada.
  • Hezhen Ren
    Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, Canada.
  • Hossein Farahani
    Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, Canada.
  • Colin Chen
    Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, Canada.
  • Derek Chiu
    Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, Canada.
  • Aline Talhouk
    Department of Obstetrics and Gynecology, University of British Columbia, Vancouver, Canada.
  • Brandon Sheffield
    Department of Pathology, William Osler Health Centre-Brampton Civic Hospital, Brampton, Canada.
  • Maziar Riazy
    Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, Canada.
  • Philip P Ip
    Department of Pathology, University of Hong Kong, Hong Kong SAR, PR China.
  • Carlos Parra-Herran
    Laboratory Medicine and Pathobiology, University of Toronto, Toronto, Canada.
  • Anne Mills
    Department of Pathology, University of Virginia, Charlottesville, VA, USA.
  • Naveena Singh
    Barts and the London School of Medicine and Dentistry, Queen Mary University of London, London, UK.
  • Basile Tessier-Cloutier
    Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, British Columbia, Canada.
  • Taylor Salisbury
    Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, Canada.
  • Jonathan Lee
    Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, Canada.
  • Tim Salcudean
    Electrical & Computer Engineering, University of British Columbia, Vancouver, Canada.
  • Steven Jm Jones
    Canada's Michael Smith Genome Sciences Centre, Vancouver, Canada.
  • David G Huntsman
    Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, Canada.
  • C Blake Gilks
    Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, Canada.
  • Stephen Yip
  • Ali Bashashati
    Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, BC, Canada.