From whole-slide image to biomarker prediction: end-to-end weakly supervised deep learning in computational pathology.

Journal: Nature protocols
PMID:

Abstract

Hematoxylin- and eosin-stained whole-slide images (WSIs) are the foundation of diagnosis of cancer. In recent years, development of deep learning-based methods in computational pathology has enabled the prediction of biomarkers directly from WSIs. However, accurately linking tissue phenotype to biomarkers at scale remains a crucial challenge for democratizing complex biomarkers in precision oncology. This protocol describes a practical workflow for solid tumor associative modeling in pathology (STAMP), enabling prediction of biomarkers directly from WSIs by using deep learning. The STAMP workflow is biomarker agnostic and allows for genetic and clinicopathologic tabular data to be included as an additional input, together with histopathology images. The protocol consists of five main stages that have been successfully applied to various research problems: formal problem definition, data preprocessing, modeling, evaluation and clinical translation. The STAMP workflow differentiates itself through its focus on serving as a collaborative framework that can be used by clinicians and engineers alike for setting up research projects in the field of computational pathology. As an example task, we applied STAMP to the prediction of microsatellite instability (MSI) status in colorectal cancer, showing accurate performance for the identification of tumors high in MSI. Moreover, we provide an open-source code base, which has been deployed at several hospitals across the globe to set up computational pathology workflows. The STAMP workflow requires one workday of hands-on computational execution and basic command line knowledge.

Authors

  • Omar S M El Nahhas
    Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany.
  • Marko van Treeck
    Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany.
  • Georg Wölflein
    School of Computer Science, University of St Andrews, St Andrews, UK.
  • Michaela Unger
    Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany.
  • Marta Ligero
  • Tim Lenz
    Else Kroener Fresenius Center for Digital Health, Medical Faculty Carl Gustav Carus, Technical University Dresden, Dresden, Germany.
  • Sophia J Wagner
    Helmholtz AI, Helmholtz Munich - German Research Center for Environmental Health, Neuherberg, Germany.
  • Katherine J Hewitt
    Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany.
  • Firas Khader
    Department of Diagnostic and Interventional Radiology, University Hospital RWTH Aachen, Aachen, Germany.
  • Sebastian Foersch
    Institute of Pathology, University Medical Center Mainz, Mainz, Germany. Electronic address: sebastian.foersch@unimedizin-mainz.de.
  • Daniel Truhn
    Department of Diagnostic and Interventional Radiology, University Hospital Düsseldorf, Düsseldorf, Germany (J.S., D.B.A., S.N.); Institute of Computer Vision and Imaging, RWTH University Aachen, Pauwelsstrasse 30, 52072 Aachen, Germany (J.S., D.M.); Department of Diagnostic and Interventional Radiology, University Hospital Aachen, Aachen, Germany (D.T., M.P., F.M., C.K., S.N.); and Faculty of Mathematics and Natural Sciences, Institute of Informatics, Heinrich Heine University Düsseldorf, Düsseldorf, Germany (S.C.).
  • Jakob Nikolas Kather
    Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany.