Artificial Intelligence-Based Tool for Tumor Detection and Quantitative Tissue Analysis in Colorectal Specimens.

Journal: Modern pathology : an official journal of the United States and Canadian Academy of Pathology, Inc
Published Date:

Abstract

Digital pathology adoption allows for applying computational algorithms to routine pathology tasks. Our study aimed to develop a clinical-grade artificial intelligence (AI) tool for precise multiclass tissue segmentation in colorectal specimens (resections and biopsies) and clinically validate the tool for tumor detection in biopsy specimens. The training data set included 241 precisely manually annotated whole-slide images (WSIs) from multiple institutions. The algorithm was trained for semantic segmentation of 11 tissue classes with an additional module for biopsy WSI classification. Six case cohorts from 5 pathology departments (4 countries) were used for formal and clinical validation, digitized by 4 different scanning systems. The developed algorithm showed high precision of segmentation of different tissue classes in colorectal specimens with composite multiclass Dice score of up to 0.895 and pixel-wise tumor detection specificity and sensitivity of up to 0.958 and 0.987, respectively. In the clinical validation study on multiple external cohorts, the AI tool reached sensitivity of 1.0 and specificity of up to 0.969 for tumor detection in biopsy WSI. The AI tool analyzes most biopsy cases in less than 1 minute, allowing effective integration into clinical routine. We developed and extensively validated a highly accurate, clinical-grade tool for assistive diagnostic processing of colorectal specimens. This tool allows for quantitative deciphering of colorectal cancer tissue for development of prognostic and predictive biomarkers and personalization of oncologic care. This study is a foundation for a SemiCOL computational challenge. We open-source multiple manually annotated and weakly labeled test data sets, representing a significant contribution to the colorectal cancer computational pathology field.

Authors

  • Johanna Griem
    Institute of Pathology, University Hospital Cologne, Cologne, Germany.
  • Marie-Lisa Eich
    Institute of Pathology, University Hospital Cologne, Cologne, Germany.
  • Simon Schallenberg
    From the Department of Radiology, Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Campus Virchow Klinikum, Augustenburgerplatz 1, 13353 Berlin, Germany (C.A.H., G.L.B., N.L.B., A.H., L.J.S., K.F., F.D., M.R., A.D.J.B., B.H., M.H., S.H., T.P.); Berlin Institute of Health (BIH), Berlin, Germany (C.A.H., N.L.B., L.J.S., T.P.); Faculty VI-Informatics and Media, Berliner Hochschule für Technik (BHT), Einstein Center Digital Future, Berlin, Germany (G.L.B., F.B.); Bayer AG, Medical Affairs and Pharmacovigilance, Integrated Evidence Generation & Business Innovation, Berlin, Germany (A.H.); Institute of Pathology, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin and Berlin Institute of Health, Berlin, Germany (S.S.); and Department of Urology, Otto-von-Guericke-University Magdeburg, Germany and PROURO, Berlin, Germany (H.C.).
  • Alexey Pryalukhin
    Institute of Pathology, Landesklinikum Wiener Neustadt, Wiener Neustadt, Austria.
  • Andrey Bychkov
    Department of Pathology, Nagasaki University Graduate School of Biomedical Sciences, Sakamoto, Nagasaki, Japan; Department of Pathology, Kameda Medical Center, Kamogawa, Chiba, Japan.
  • Junya Fukuoka
    Department of Pathology, Nagasaki University Graduate School of Biomedical Sciences, Sakamoto, Nagasaki, Japan; Department of Pathology, Kameda Medical Center, Kamogawa, Chiba, Japan. Electronic address: fukuokaj@nagasaki-u.ac.jp.
  • Vitaliy Zayats
    Laboratory for Medical Artificial Intelligence, The Resource Center for Universal Design and Rehabilitation Technologies (RCUD and RT), Moscow, Russia.
  • Wolfgang Hulla
    Institute of Pathology, Landesklinikum Wiener Neustadt, Wiener Neustadt, Austria.
  • Jijgee Munkhdelger
    Department of Pathology, Kameda Medical Center, Kamogawa, Japan.
  • Alexander Seper
    Danube Private University, Medical Faculty, Krems-Stein, Austria.
  • Tsvetan Tsvetkov
    Institute of Pathology, University Hospital Cologne, Cologne, Germany.
  • Anirban Mukhopadhyay
    Zuse Institute Berlin, Berlin, Germany.
  • Antoine Sanner
    Department of Neuroradiology, University Medical Center Mainz, Mainz, Germany.
  • Jonathan Stieber
    Technical University Darmstadt, Darmstadt, Germany.
  • Moritz Fuchs
    Informatics, TU Darmstadt, Germany.
  • Niklas Babendererde
    Technical University Darmstadt, Darmstadt, Germany.
  • Birgid Schömig-Markiefka
    Institute of Pathology, University Hospital Cologne, Cologne, Germany.
  • Sebastian Klein
    Else-Kröner-Forschungskolleg, Clonal Evolution in Cancer, University Hospital Cologne, Cologne, Germany. Sebastian.Klein@uk-koeln.de.
  • Reinhard Buettner
    Institute of Pathology, University Hospital Cologne, Cologne, Germany.
  • Alexander Quaas
    Institute of Pathology, University Hospital Cologne, Cologne, Germany.
  • Yuri Tolkach
    Institute of Pathology, University Hospital Cologne, Cologne, Germany. yuri.tolkach@gmail.com.