Annotation Practices in Computational Pathology: A European Society of Digital and Integrative Pathology (ESDIP) Survey Study.

Journal: Laboratory investigation; a journal of technical methods and pathology
PMID:

Abstract

Integrating digital pathology and artificial intelligence (AI) algorithms can potentially improve diagnostic practice and precision medicine. Developing reliable, generalizable, and comparable AI algorithms depends on access to meticulously annotated data. However, achieving this requires robust collaboration among pathologists, computer scientists, and other researchers to ensure data quality and consistency. The lack of standardization and scalability is a significant challenge when generating annotations and annotated data sets. Recognizing these limitations, the Scientific Committee of the European Society of Digital and Integrative Pathology (ESDIP) performed a comprehensive international survey to understand the current state of annotation practices and identify actionable areas to address critical needs in the annotation process. The analysis and summary of the survey results provide several insights for all stakeholders involved in data preparation and ground truthing, ultimately contributing to the advancement of AI in computational pathology.

Authors

  • Diana Montezuma
  • Sara P Oliveira
  • Yuri Tolkach
    Institute of Pathology, University Hospital Cologne, Cologne, Germany. yuri.tolkach@gmail.com.
  • Peter Boor
    Institute of Pathology, University Hospital Aachen, RWTH Aachen University, Aachen, Germany.
  • Alex Haragan
    European Society of Digital and Integrative Pathology (ESDIP), Lisboa, Portugal; Department of Pathology, Royal Liverpool University Hospital, Liverpool, United Kingdom.
  • Rita Carvalho
    Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt Universität zu Berlin, Institute of Pathology, Charitéplatz 1, 10117, Berlin, Germany.
  • Vincenzo Della Mea
    Department of Mathematics, Computer Science and Physics, University of Udine Italy.
  • Tim-Rasmus Kiehl
    Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Pathology, Berlin, Germany.
  • Sabine Leh
    European Society of Digital and Integrative Pathology (ESDIP), Lisboa, Portugal; Department of Pathology, Haukeland University Hospital, Bergen, Norway; Department of Clinical Medicine, University of Bergen, Bergen, Norway.
  • Mustafa Yousif
    Department of Pathology, University of Michigan, Ann Arbor, MI, USA. Yousif.mustafa@outlook.com.
  • David Ameisen
    European Society of Digital and Integrative Pathology (ESDIP), Lisboa, Portugal; Imginit SAS, Paris, France.
  • Mircea-Sebastian Șerbănescu
    European Society of Digital and Integrative Pathology (ESDIP), Lisboa, Portugal; Department of Medical Informatics and Biostatistics, University of Medicine and Pharmacy of Craiova, Romania.
  • Norman Zerbe
    Department of Digital Pathology and IT, Institute of Pathology, Charité University Hospital, Berlin, Germany.
  • Vincenzo L'Imperio
    Department of Medicine and Surgery, ASST Monza, San Gerardo Hospital, University of Milano-Bicocca, Monza, Italy.