Artificial neural networks and pathologists recognize basal cell carcinomas based on different histological patterns.

Journal: Modern pathology : an official journal of the United States and Canadian Academy of Pathology, Inc
Published Date:

Abstract

Recent advances in artificial intelligence, particularly in the field of deep learning, have enabled researchers to create compelling algorithms for medical image analysis. Histological slides of basal cell carcinomas (BCCs), the most frequent skin tumor, are accessed by pathologists on a daily basis and are therefore well suited for automated prescreening by neural networks for the identification of cancerous regions and swift tumor classification.In this proof-of-concept study, we implemented an accurate and intuitively interpretable artificial neural network (ANN) for the detection of BCCs in histological whole-slide images (WSIs). Furthermore, we identified and compared differences in the diagnostic histological features and recognition patterns relevant for machine learning algorithms vs. expert pathologists.An attention-ANN was trained with WSIs of BCCs to identify tumor regions (n = 820). The diagnosis-relevant regions used by the ANN were compared to regions of interest for pathologists, detected by eye-tracking techniques.This ANN accurately identified BCC tumor regions on images of histologic slides (area under the ROC curve: 0.993, 95% CI: 0.990-0.995; sensitivity: 0.965, 95% CI: 0.951-0.979; specificity: 0.910, 95% CI: 0.859-0.960). The ANN implicitly calculated a weight matrix, indicating the regions of a histological image that are important for the prediction of the network. Interestingly, compared to pathologists' eye-tracking results, machine learning algorithms rely on significantly different recognition patterns for tumor identification (p < 10).To conclude, we found on the example of BCC WSIs, that histopathological images can be efficiently and interpretably analyzed by state-of-the-art machine learning techniques. Neural networks and machine learning algorithms can potentially enhance diagnostic precision in digital pathology and uncover hitherto unused classification patterns.

Authors

  • Susanne Kimeswenger
    Johannes Kepler University Linz, Kepler University Hospital Linz, Department of Dermatology, Linz, Austria.
  • Philipp Tschandl
    Department of Computing Science, Simon Fraser University, Burnaby, British Columbia, Canada.
  • Petar Noack
    Kepler University Hospital Linz, Department of Pathology and Microbiology, Linz, Austria.
  • Markus Hofmarcher
    LIT AI Lab & Institute for Machine Learning , Johannes Kepler University , Linz 4040 , Austria.
  • Elisabeth Rumetshofer
    LIT AI Lab & Institute for Machine Learning , Johannes Kepler University , Linz 4040 , Austria.
  • Harald Kindermann
    University of Applied Sciences, Upper Austria, Marketing and Electronic Business, Steyr, Austria.
  • Rene Silye
    Kepler University Hospital Linz, Department of Pathology and Microbiology, Linz, Austria.
  • Sepp Hochreiter
    Institute for Machine Learning Johannes Kepler University Linz Austria.
  • Martin Kaltenbrunner
    Johannes Kepler University Linz, Institute of Applied Physics, Department of Soft Matter Physics, Linz, Austria.
  • Emmanuella Guenova
    Department of Dermatology, University Hospital Zurich and Faculty of Medicine, University of Zurich, Zurich, Switzerland.
  • Guenter Klambauer
    LIT AI Lab & Institute of Bioinformatics , Johannes Kepler University , 4040 Linz , Austria.
  • Wolfram Hoetzenecker
    Johannes Kepler University Linz, Kepler University Hospital Linz, Department of Dermatology, Linz, Austria. wolfram.hoetzenecker@kepleruniklinikum.at.