Fine-Tuning and training of densenet for histopathology image representation using TCGA diagnostic slides.

Journal: Medical image analysis
Published Date:

Abstract

Feature vectors provided by pre-trained deep artificial neural networks have become a dominant source for image representation in recent literature. Their contribution to the performance of image analysis can be improved through fine-tuning. As an ultimate solution, one might even train a deep network from scratch with the domain-relevant images, a highly desirable option which is generally impeded in pathology by lack of labeled images and the computational expense. In this study, we propose a new network, namely KimiaNet, that employs the topology of the DenseNet with four dense blocks, fine-tuned and trained with histopathology images in different configurations. We used more than 240,000 image patches with 1000×1000 pixels acquired at 20× magnification through our proposed "high-cellularity mosaic" approach to enable the usage of weak labels of 7126 whole slide images of formalin-fixed paraffin-embedded human pathology samples publicly available through The Cancer Genome Atlas (TCGA) repository. We tested KimiaNet using three public datasets, namely TCGA, endometrial cancer images, and colorectal cancer images by evaluating the performance of search and classification when corresponding features of different networks are used for image representation. As well, we designed and trained multiple convolutional batch-normalized ReLU (CBR) networks. The results show that KimiaNet provides superior results compared to the original DenseNet and smaller CBR networks when used as feature extractor to represent histopathology images.

Authors

  • Abtin Riasatian
    Kimia Laboratory, University of Waterloo, Waterloo, Canada.
  • Morteza Babaie
  • Danial Maleki
    Kimia Laboratory, University of Waterloo, Waterloo, Canada.
  • Shivam Kalra
  • Mojtaba Valipour
    School of Computer Science, University of Waterloo, 200 University Ave. W., Waterloo, ON, Canada.
  • Sobhan Hemati
    Kimia Lab, University of Waterloo, 200 University Ave. W., Waterloo, ON, Canada.
  • Manit Zaveri
  • Amir Safarpoor
  • Sobhan Shafiei
  • Mehdi Afshari
    Kimia Lab, University of Waterloo, 200 University Ave. W., Waterloo, ON, Canada.
  • Maral Rasoolijaberi
    Kimia Lab, University of Waterloo, 200 University Ave. W., Waterloo, ON, Canada.
  • Milad Sikaroudi
  • Mohd Adnan
    Department of Biology, College of Science, University of Ha'il, P.O. Box 2440, Ha'il, Saudi Arabia.
  • Sultaan Shah
  • Charles Choi
    Huron Digital Pathology, 1620 King Street North, St. Jacobs, ON, Canada.
  • Savvas Damaskinos
    Huron Digital Pathology, 1620 King Street North, St. Jacobs, ON, Canada.
  • Clinton Jv Campbell
    Department of Pathology and Molecular Medicine, McMaster University, Hamilton, Canada.
  • Phedias Diamandis
    Department of Laboratory Medicine and Pathobiology, University of Toronto, Toronto, ON, M5S 1A8, Canada. p.diamandis@mail.utoronto.ca.
  • Liron Pantanowitz
    Department of Pathology, University of Michigan, Ann Arbor, MI, USA.
  • Hany Kashani
  • Ali Ghodsi
    Department of Statistics and Actuarial Science, University of Waterloo, Waterloo, ON, Canada.
  • H R Tizhoosh